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1.  INTRODUCTION 


The  Human  Resources  Test  and  Evaluation  System  (HRTES)  Workbook  consists  of 
a  series  of  Worksheets  and  applicable  Guidelines.  Each  Worksheet  and 
Guideline  is  referenced  by  associated  text  in  a  chapter  of  the  HRTES 
Handbook.  The  chapter  numbers  in  the  Workbook  and  the  Handbook  are 
equivalent.  When  Chapter  5  of  the  Handbook  references  Worksheets  and 
Guidelines  in  the  Workbook,  they  will  be  found  in  Workbook  Chapter  5. 

Since  the  HRTES  Workbook  is  likely  to  be  used  for  more  than  one  Operational 
Test,  the  recommended  strategy  is  to  use  the  contained  Worksheets  as  master 
copies.  When  each  is  to  be  used,  copy  it,  and  work  only  on  the  copy. 

If  you  make  additions  or  substantial  changes  to  the  material  in  HRTES,  such 
as  adding  new  "System  Performance  Issues,"  "Conditons,"  or  "Human  Performance 
Functions,"  it  is  suggested  that  you  include  a  statement  of  these  changes 
on  a  copy  of  a  HRTESGRAM  (see  the  following  page),  and  send  it  to: 


U.S.  ARMY  RESEARCH  INSTITUTE 

for  the  BEHAVIORAL  and  SOCIAL  SCIENCES 

Attention:  PERI-SZ 

5001  Eisenhower  Avenue 

Alexandria.  Virginia  22333 


HRTGSGRAM 


We  suggest  that  the  following 
change(s),  addltlon(s),  or  deiefion(s) 
be  made  to  HRTES: 


■  GUIDELINES  FOR  ASSIGNING  HPF'S  CRITERIA 

LJL^  I  and  STATISTICS  WITHIN  THEIR  OVERALL 

I  ir\  I  SPT  CRITERION 


SPI  CRITERION: 


HPF'S  WHOSE  CRITERIA  AND  STATISTICS  ARE  COMPONENTS  OF  THE  ABOVE  SPI 'S 
TIME  AND  ERROR  BUDGET: 


HRTGS 


2.  SYSTEM  INDEX 


CONTENTS 

Definition  of  System  to  be  Tested 
Set  of  twelve  System  Function  Worksheets 
Guidelines  for  Selecting  System  Functions 
Sample  System  Function  Worksheet 
System  Rating  Questionnaire 


DEFINITION  OF  SYSTEM  TO  BE  TESTED 


HRTGS 


ITEMS  TO  BE  INCLUDED  IN  TEST  (Number  and  Type): 


OPERATOR  AND  MAINTAINER  PERSONNEL  (Number  and  Type): 


SYSTEM  TO  BE  AUGMENTED  OR  REPLACED: 


DIAGRAM  OF  SYSTEM  TO  BE  TESTED: 


i 
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SYSTEM  FUNCTION  WORKSHEET 
FOR  AIR  DEFENSE  WEAPONS 


SYSTEM  CLASS: 

AIR  DEFENSE  WEAPONS  Including: 
Short  Range  Missiles.  Medium  Range 
Missiles.  Long  Range  Missiles.  Air 
Defense  Guns,  High  Energy  Systems 


SYSTEM  FUNCTION  RATINGS 


— J  ^  — I 

COCD  C/>CO 


SYSTEM  FUNCTIONS 


1,2,4  36 
5,7  35 

34 
33 
32 


2.3,7  24 
23 
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SYSTEM  FUNCTION  WORKSHEET 
FOR  ARMORED  VEHICLES 


SYSTEM  CLASS; 

ARMORED  VEHICLES  including;  Main 
Battle  Tanks,  Armored  Reconnaissance 
Vehicles /Light  Tanks,  Infantry/ Cavalry 
Fighting  Vehicle,  Armored  Personnel 
Carriers-Mounting,  Anti-Tank  Weapons 


SYSTEM  FUNCTION  RATINGS 


SYSTEM  FUNCTIONS 


1  Destroy  fixed  emplacements. 


2  Destroy  armored  vehicles. 


3.  Destroy  enemy  personnel. 


4.  Destroy/disrupt  enemy  aircraft. 


5.  Suppress/disrupt  enemy  activity. 


6.  Serve  as  a  platform  for  mounted 
attack. 


7.  Transport  troops/materiel. 


8.  Perform  reconnaissance. 


9  Protect  crew/passengers/materiel 
from  enemy  action. 


1 .2.5 

7  25 

-  34 

1  ,2,5  33 
7  32 

-  31 

1.2.5  30 

7  29 

28 
27 
26 
25 
24 
23 

1  2  5  22 
7  21 

_ 20 

19 

2.5,7 

_  17 

2.5.6  16 

7  15 


1,2,5 

7 
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SYSTEM  FUNCTION  WORKSHEET 
FOR  AVIATION  SYSTEMS 


SYSTEM  FUNCTION  RATINGS 


SYSTEM  CLASS: 

AVIATION  SYSTEMS  inc'jding: 

Attack  Helicopters,  Scout  Helicopters, 
Transport  Helicopters,  Utility  Helicopters, 
Fixed-Wing  Reconnaissance.  Fixed- 
Wing  Transport 


O 

^  CO  ^  u.  cn  ^ 
to  t  CO  CO  CD 

cqu  yy 

<o 


2  2 
CL  CO  Q.  3 


SYSTEM  FUNCTIONS 


1  Destroy  enemy  vehicles. 


2  Destroy  anti-aircraft  systems. 


3.  Destroy  fixed  emplacements. 


4  Destroy  enemy  personnel. 


5.  Disajpt/ suppress  enemy  activity. 


6  Perform  reconnaissance. 


7  Serve  as  platform  for  electronics 
warfare  systems 


8  Transport  troops -'materiel 


9  Transport  injured  troops 


10  Protect  crew  -  passengers /materiel 
from  enemy  action. 


1,2,5 

7 


36 
35 
34 

1,2,5  33 
7  32 

-  31 

1  ,2,5  30 

7  29 

- 28 

1.2,527 

2  _ 26 

24 
23 
22 
21 
20 
19 
18 
17 
16 
15 
14 
13 

2,5,7  12 
-  11 

2,3 


2,5,7 


W2-6 
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SYSTEM  FUNCTION  WORKSHEET 
FOR  CVC*I  SYSTEMS 


SYSTEM  FUNCTION  RATINGS 


SYSTEM  CLASS: 

C»/C*l  SYSTEMS  including: 

Field  Artillery  Fire  Control,  Tank  Fire 
Control ,  Air  Defense  Fire  Control 


Sts 

50  yS 


00—  mu  y)?: 

<5  <n  csg 

CD  LU  QQ  ^  UJ 

0&5  Ow  zo 

S  ^  S  z  oj  < 

Q-m  Q-3  Ox 


SYSTEM  FUNCTIONS 


1  Provide  information  on  current 
battlefield  conditions  and  situation. 


2.  Provide  projections  of  probable  future 
conditions  and  enemy  behovior. 


3.  Control  the  behavior  of  friendly 
forces. 


4.  Manage  friendly  weapon 
operation. 


5.  Manage  logistics. 


6.  Communicate  information  to 
appropriate  units. 


7.  Protect  system/crew  from  enemy 
action. 


36 

4,7  35 
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SYSTEM  FUNCTION  WORKSHEET 

FOR  COMBAT/TACTICAL  SUPPORT  EQUIPMENT 


SYSTEM  CLASS: 

COMBAT/TACTICAL  SUPPORT 
EQUIPMENT  including:  Combat 
Engineer  Vehicles,  Recovery  Vehicles, 
Demolition  Equipment,  and  Bridging 
Equipment 


SYSTEM  FUNCTION  RATINGS 


^  tu  ^  uu 


<u 


coco  CO  CO 

OO  ug 


SYSTEM  FUNCTIONS 


CU  ^  LU  tr 

Qco  £L  O 


wj  ir  ^ 

c:  >  aZ 

Q.  CO  Q.  3 


ZQ  Oq 


q:< 
Ox  cox 


1  Destroy/remove  obstacles/ 
roadblocks. 


2.  Construct  obstacles/roadblocks. 


3.  Bridge  obstacles. 


1,2,536 

7  35 

- 34 

1 ,2,5  33 
7  32 

-  31 

2,5,7  30 


4.  Construct  emplacement/shelters. 


5.  Transport  command  posts. 


6.  Transport  damaged  vehicles. 


7.  Destroy  armored  vehicles/ 
personnel. 


8.  Protect  crew/material  from  enemy 
action. 


SYSTEM. 


NAME. 


TELEPHONE 


.WWW-. 


■■  ■/v;--.-.-; 


KLS  mJ'. 
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SYSTEM  CLASS: 

ELECTRONIC  WARFARE  AND 
SURVEILLANCE  SYSTEMS  including: 
Countermeasures  Equipment  and 
Sighting  and  Surveillance  Equipment. 


SYSTEM  FUNCTION  WORKSHEET 

FOR  ELECTRONIC  WARFARE  &  SURVEILLANCE  SYSTEMS 


SYSTEM  FUNCTION  RATINGS 


SYSTEM  FUNCTIONS 


1.  Provide  critical  information  on 
potential  targets. 


2.  Confuse  -  disrupt/  disable  enemy 
systems. 


3.  Protect  opetator/crew  from  enemy 
action 


4  Jam  electronic  signals. 


5.  Produce  false  targets/target 
signatures. 


36 
35 
34 
33 
32 
31 

2.3,5  30 
7  29 


SYSTEM. 


NAME. 


TELEPHONE 


f- . 
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SYSTEM  CLASS: 

GROUND  TRANSPORTATION 
EQUIPMENT  including:  1/4  Ton  Ltility 
Trucks,  3/4  to  1-1/2  Ton  Trucks,  6  Ton 
Trucks,  8  to  10  Ton  Trucks,  Heavy 
Equipment  Transport  Trucks 


SYSTEM  FUNCTION  WORKSHEET 

FOR  GROUND  TRANSPORTATION  EQUIPMENT 


SYSTEM  FUNCTION  RATINGS 


o 

QO 
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SYSTEM  FUNCTIONS 


1.  Transport  command  personnel. 


2.  Transport  troops. 


3.  Transport  materiel. 


4.  Serve  as  an  ambulance. 


5.  Protect  operator /crew  from  enemy 
action. 


SYSTEM 
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SYSTEM  FUNCTION  WORKSHEET 
FOR  INFANTRY  WEAPONS 


HRT6S 


SYSTEM  CLASS: 

INFANTRY  WEAPONS  including; 
Pistols/revolvets,  Rifles,  Sub-Machine 
Guns.  Machine  Guns,  Recoilless  Rifles, 
Anti-Tank  Missile  Systems,  Anti-Aircraft 
Missile  Systems,  Grenades /Grenade 
Launchers.  Anti- Armor  Mir\es,  Anti- 
Personnel  Mines,  Flamethrowers. 
Mortars 


SYSTEM  FUNCTIONS 


SYSTEM  FUNCTION  RATINGS 


O  03 

50  5t2 

“5^  coo  yS 


cau 

<5  <  O  o:  ? 

CO  uj  «a  5  Lu 

0&5 

gi 


1  Destroy  enemy  vehicles. 


2.  Destroy  low  flying  enemy  aircraft. 


3.  Destroy  fixed  emplacements. 


4.  Destroy  enemy  troops. 


5.  Disrupt /suppress  enemy  activity. 


36 
35 
34 
33 

1,7  32 

31 
30 
29 
28 
27 
26 
.25 
1,7  24 


6.  Provide  illumination. 


7.  Protect  operator/crew  from  enemy 
action. 


8.  Conceal  friendly  forces  by  making 
smoke. 


SYSTEM . 


NAME- 


-TELEPHONE- 


w2-n 
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SYSTEM  FUNCTION  WORKSHEET 
FOR  ORDNANCE  SYSTEMS 


jk.. 
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SYSTEM  FUNCTION  RATINGS 


SYSTEM  CLASS: 

ORDNANCE  SYSTEMS  including; 

Light,  Towed,  Tube  Artillery;  Light, 
Self-Propelled,  Tube  Artillery;  Medium, 
Towed,  Tube  Artillery;  Medium  Self- 
Propelled,  Tube  Artillery,  Heavy,  Towed 
Tube  Artillery;  Heavy,  Self-Propelled 
Tube  Artillery;  Battlefield  Support 
Guided  Missile;  Battlefield  Support 
Unguided  Missiles;  Multiple  Launch, 
Guided  Missiles;  Multiple  Launch, 
Unguided  Missiles 

SYSTEM  FUNCTIONS 


1  Destroy  fixed  emplacements  on  or 
behind  the  battlefield. 


2.  Destroy  enemy  vehicles/weapons. 


3.  Destroy  enemy  personnel. 


4.  Suppress/deny  enemy  activity,  and 
deny  terrain  to  enemy. 


5.  Provide  illumination. 


6.  Conceal  friendly  forces  by  making 
smoke. 


7.  Protect  crew/material  from  enemy 
action. 


o:  £  OK 

LLlfc  £V  > 

Q-  O  Q.  CO 


1,2,5 

7 


36 
35 
34 
33 
32 
31 
3C 
2<? 
28 

1,2,5  27 

^  26 

12  5^^ 
7'^'^  24 

23 

22 

12  5 

21 

7 

f  on 
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SYSTEM  FUNCTION  WORKSHEET 

FOR  TARGET  ACQUISITION  AND/OR  DESIGNATOR  SYSTEMS 


SYSTEM  FUNCTION  RATINGS 


SYSTEM  CLASS: 

TARGET  ACQUISITION  AND/OR 
DESIGNATOR  SYSTEMS 

SYSTEM  FUNCTIONS 

1.  DESIGNED  FOR 

SYSTEM  FUNCTION 

2.  PERFORMED  WITH 

OTHER  FUNCTIONS 

3.  PROBABILITY  OF 

SYSTEM  LOSS 

4.  PROBABILITY  OF 

UNSUCCESSFUL  CONDUCT 

5.  GENERIC  SYSTEMS 

HAD  PROBLEMS 

6.  SPECIFIC  SYSTEM 

HAD  PROBLEMS 

^SUM  OF  RATINGS/ 
SELECTION  WEIGHT 

-*-SPI  CATEGORY  REFERENCES 

1.  Provide  critical  information  on 
potential  targets 

■ 

2.  Designate/illuminate  target. 

7,8 

3.  Protect  system /crew  from  enemy 
action. 

■ 

_! 

■ 

■ 

36  -- 

35 

34 

33 

32 

31 

30 

29  . 

28  _ 

27 _ 

26 
25  „ 

24 _ 

23  _  .  _ 

22 _ 

21  _ 
20 

19 _ 

18 _ 

17 _ 

16  - _ 

15 _ 

14 _ 

13 _ 

12 _ 

11  _ 

10 _ 

9 _ 

8 _ 

7 _ 

6  - _ 

5 _ 

4 _ 

3  _ 

2 _ 

1  _ 

0 _ 


SPI  CATEGORY  REFERENCES 
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GUIDELINES  FOR  SELECTING 
SYSTEM  FUNCTIONS 


a 


System  Functions  are  the  ultimate  purposes  of  a  system,  not  intermediate 
steps  leading  to  those  purposes.  Normally  they  are  purposes  which  can 
be  performed  successfully  by  an  individual  system.  To  develop  a  test 
plan,  it  is  necessary  that  the  most  critical  System  Functions  be  identi¬ 
fied  and  included.  To  insure  that  the  field  test  is  not  impract ica I  I y 
long  or  expensive,  it  is  necessary  that  less  critical  System  Functions  be 
identified  and  eliminated  from  consideration.  To  evaluate  field  test 
results,  it  is  necessary  that  the  relative  criticality  of  System  Functions 
which  are  tested  be  specified.  The  process  of  weighting  the  criticality 
of  System  Functions  is  described  below. 

(1)  Read  the  "System  Function  Worksheet,"  and  add  any  System 
Functions  you  find  relevant  to  your  system  which  are  not 
present.  These  new  System  Functions  will  be  treated  in 
the  same  manner  as  those  already  listed. 

(2)  Rate  each  System  Function  using  the  "System  Function  Rating 
Questionnaire."  Record  the  values  on  the  "System  Function 
Worksheet."  (See  "Sample  System  Function  Worksheet.") 

(3)  Total  the  ratings  for  each  System  Function,  and  enter  this 
total  in  the  "Sum  of  Rating/Selection  Weight"  column  of 
the  "System  Function  Worksheet." 

(4)  Record  the  identification  number  of  each  System  Function 
(which  precedes  each  System  Function)  in  the  last  column, 
according  to  the  sum  of  its  ratings.  For  example,  if 
System  Function  number  I  received  a  sum  of  ratings  of  24, 
then  the  number  "I"  would  be  recorded  on  I i ne  24  in  the 
last  column. 


SAMPLE 
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SYSTEM  FUNCTION  WORKSHEH 
FOR  AIR  DEFENSE  WEAPONS 


SYSTEM  CLASS; 

AIR  DEFENSE  WEAPONS  including: 
Short  Rang*  Missiiot.  Medium  Rang* 
MissilM.  Long  Rang*  Miuilai.  Air 
0*r*ns*  Guns.  High  Energy  Systoms 


SYSTEM  FUNCTION  RATINGS 


SYSTEM  FUNCTIONS 


J 


not 

lo 


I 


§ 


so 


02 


ai5 


as 

Uq 

^1 


oS 

|i 
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1  Destroy  a/cratt. 


4 


1,2, 

4.5,' 


2  Contuse  and  disfuot  oircratt. 


1,2.. 

5,7 


3.  Deny  selected  aSrspace/toimotlon 
to  ottociiing  arcratt. 


/f 


1,2,. 

5,7 


4.  Destroy  graund  targets. 


1.2 

5,7 


5.  Protect  operator/ crew  trom  enemy 
dctton. 


>7 


2.3. 

7 


SPi  CATEGORY  REFERENCES 
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RATING  QUESTIONNAIRE  FOR  DETERMINING 
CRITICALITY  OF  SYSTEM  FUNCTION 


- - 1 

To  determine  the  relative  criticality  of  a  System  Function  for  the 

system,  rate  each  System  Function  against  the  attributes  of  criticality 
listed  below.  This  is  done  by  assigning  a  number  from  zero  to  six  to 
each  attribute,  and  record  them  on  the  "System  Function  Worksheet." 


1.  DESIGNED  FOR  SYSTEM  FUNCTION:  To  what  extend  is  this  system,  or  a 
major  component  of  this  system,  designed  specifically  to  carry  out  this 
System  Function? 


No 

Some 

Very  Great 

Extent 

Extent 

Extent 

0  1 

2  3 

4 

5 

6 

Not  designed 

Design  incor¬ 

Designed  speci- 

for  System 

porates  System 

f Ica 1 1 y  for 

Function 

Function 

System  Function 

2.  PERFORMED  WITH  OTHER 

FUNCTIONS:  How  often/how  long  will 

this  System 

Function  be  performed  in 

comparison  to  its  other  System  Functions? 

Never 

Moderately 

A 1  ways 

0  I  2 

3  4  5 

6 

This  System 

This  System 

Only  this 

Function 

Function  performed 

System  Func¬ 

never  performed 

as  often  as  others 

tion  performed 
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RATING  QUESTIONNAIRE  FOR  DETERMINING 
CRITICALITY  OF  SYSTEM  FUNCTION  (Continued) 


3.  PROBABILITY  OF  SYSTEM  LOSS:  To  what  extent  would  failure  to  success¬ 
fully  complete  this  System  Function  in  expected  battlefield  conditions 
increase  the  probability  of  system  loss? 


No 

Extent 


Some 

Extent 


Very  Great 
Extent 


No  increase 
in  probabi I ity 


Some  increase 
in  probabi I ity 


Great  increase 
i n  probabi I i ty 


4.  PROBABILITY  OF  UNSUCCESSFUL  CONDUCT:  To  what  extent  would  failure 
to  successfully  complete  this  System  Function  increase  the  probability 
of  unsuccessful  conduct  of  the  military  exercise? 


No 

Extent 


Some 

Extent 


Very  Great 
Extent 


No  increase 
i n  probabi I i ty 


Some  increase 
in  probabi I ity 


Great  increase 
i n  probab i I i ty 


5.  GENERIC  SYSTEMS  HAD  PROBLEMS:  To  what  extent  have  other  systems  in 
this  generic  class  had  a  history  of  problems  in  carrying  out  this  System 
Function?  (If  this  is  an  entirely  new  System  Function  for  this  generic 
class,  rate  this  question  six.) 


No 

Extent 


Some 

Extent 


Very  Great 
Extent 


No  problems 


Some  non- 
severe  problems 


Severe  and/or 
frequent  problems 


W2-t9 


M. 
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RATING  QUESTIONNAIRE  FOR  DETERMINING 
CRITICALITY  OF  SYSTEM  FUNCTION  (Continued] 


6.  SPECIFIC  SYSTEM  HAS  PROBLEMS:  To  what  extent  have  prior  OT's  and 
DT's  of  this  specific  system  demonstrated  a  history  of  problems  in 
performing  this  System  Function?  (If  this  System  Function  has  not  been 
tested  in  a  prior  OT  or  DT,  substitute  the  following  question;  To  what 
extent  do  you  predict  that  this  System  Function  will  have  performance 
prob I ems?  ) 


No 

Extent 


Some 

Extent 


Very  Great 
Extent 


No  problems 


Some  non- 
severe  problems 


Severe  and/or 
frequent  problems 


HRTeS  3.  SYSTEM  PERFORMANCE  ISSUE  (SPi)  INDEX 


CONTENTS 

1.  System  Performance  Issue  (SPI)  Worksheet 

2.  Guidelines  for  Selecting  SPI’s 

3.  Sample  System  Performance  Issue  Worksheet 

4.  SPI  Rating  Questionnaire 

5.  SPI  Cutoff  Worksheet 


HRT€S  SYSTEM  PERFORMANCE  ISSUE  WORKSHEET 


SELECTED  SPI  (*) 


HRTGS 


GUIDELINES  FOR  SELECTING 
SYSTEM  PERFORMANCE  ISSUES 


r 


System  Performance  Issues  (SPI’s)  are  the  intermediate  actions  which  the 
system  must  take  to  perform  each  System  Function.  Normally,  they  are 
formatted  as  questions.  It  is  the  answers  to  these  SPI  questions  which 
are  sought  in  the  field  tests.  On  your  "System  Performance  Issue  Work¬ 
sheets"  they  are  formatted  as  statements  both  to  simplify  the  rating 
process  and  to  save  space.  These  SPI's  do  not  contain  mention  of  tactics 
training.  Human  Factors  Engineering,  nor  any  other  condition  in  general. 
They  are  phrased  as  simple  actions.  Qualifying  conditions  will  be  added, 
as  required,  in  a  later  stage  of  the  HRTES  procedures. 

You  have  received  a  package  of  Worksheets  including:  (a)  "System  Perfor¬ 
mance  Issue  Worksheets"  for  each  System  Function,  (b)  an  "SPI  Rating 
Questionnaire,"  (c)  "Guidelines  for  Selecting  SPI's"  (which  you  are  readi 
at  this  moment),  and  (d)  a  "Sample  Worksheet."  You  are  asked  to  aid  in 
the  process  of  selecting  the  appropriate  SPl's. 

(1)  Examine  the  "System  Performance  Issue"  Worksheets  you  have 
received  and  add  any  issues  you  feel  are  significant  for 
that  System  Function.  Those  new  SPI's  will  be  treated  in 
the  same  manner  as  those  already  listed. 

(2)  Read  the  "SPI  Rating  Questionnaire"  found  in  this  package. 

(3)  Rate  each  SPI  according  to  the  specific  attributes  in  the 
questionnaire.  Record  the  ratings  in  the  "SPI  Rating 
Columns"  of  the  Worksheet.  (See  "Sample  SPI  Worksheet.") 
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GUIDELINES  FOR  SELECTING 

SYSTEM  PERFORMANCE  ISSUES  (Continued) 


(4)  Total  the  ratings  for  each  SPI,  and  enter  this  total  in 
the  ’’Sum  of  Ratings  Column."  Do  not  write  in  the  last 
3  columns  of  the  Worksheet. 

(5)  Return  the  completed  Worksheets  to  sender. 
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SilECIED  SPI  n 


HRT€S 


RATING  QUESTIONNAIRE  FOR  DETERMINING 
CRITICALITY  OF  SYSTEM  PERFORMANCE  ISSUES 


To  determine  the  relative  criticality  of  SPI's  for  a  given  System  Function, 
rate  each  SPI  against  the  attributes  of  criticality  listed  below.  This 
is  done  by  assigning  a  number  from  zero  to  six  on  each  criticaiity  at¬ 
tribute  for  each  SPI. 


I.  PERFORMED  WITH  OTHER  SPl*s;  How  often/how  long  will  this  SPI  be 
performed  in  comparison  to  the  performance  of  other  SPI’s? 


Never 


Moderately 


A I  ways 


0 


2  3  4 


5  6 


This  SPI  not 
performed 


This  SPI  performed 
as  often  an  others 


Only  this  SPI 
i s  performed 


2.  PROBABILITY  OF  SYSTEM  FUNCTION  FAILURE;  To  what  extent  would  failure 
to  successfully  complete  this  SPI  Increase  the  probability  of  System 
Function  fa i I ure? 


No 

Extent 


Some 

Extent 


Very  Great 
Extent 


0 


2 


3  4 


5  6 


No  increase 
in  probabi I ity 


Some  increase 
in  probabi I i ty 


Great  Increase 
i n  probabi I i ty 
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RATING  QUESTIONNAIRE  FOR  DETERMINING 
CRITICALITY  OF  SYSTEM  PERFORMANCE  ISSUES 

(Continued) 


3.  GENERIC  SYSTEMS  HAD  PROBLEMS:  To  what  extent  have  other  systems 
in  this  generic  class  had  a  history  of  problems  in  carrying  out  this 
SPI  as  part  of  the  System  Function?  (If  this  is  an  entirely  new  SPI 
for  this  generic  class,  rate  this  question  six.) 


No 

Extent 


Some 

Extent 


Very  Great 
Extent 


0 


2  3  4 


5  6 


No  h i story 
of  problems 


History  of 
some  non- 
severe  problems 


Hi  story  of 
severe  and/or 
frequent  problems 


4.  SPECIFIC  SYSTEM  HAD  PROBLEMS;  To  what  extent  have  prior  DT’s/OT's 
for  this  specific  system  demonstrated  a  history  of  problems  in  success¬ 
fully  carrying  out  this  SPI  as  part  of  the  System  Function?  (If  this 
SPI  has  not  been  tested  in  a  prior  OT  or  DT,  substitute  the  following 
question:  To  what  extent  do  you  predict  that  this  SPI  will  have  per¬ 
formance  problems? 


No 

Some 

Very  Great 

Extent 

Extent 

Extent 

0  1 

2  3  4 

5 

6 

No  problems 

Some  non- 
severe  problems 

Severy  and/ 
or  frequent 
problems 

V  V 
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SPI  CUTOFF  WORKSHEET 


UNSELECTED  SPI’s 


PRODUCTS 


RELATED  SYSTEM  FUNCTION 


HRTGS 


4.  CONDITION  CATEGORY  INDEX 


CONTENTS 

Set  of  Condition  Rating  Worksheets 
Guidelines  for  Selecting  Conditions 
Sample  Condition  Rating  Worksheets 
Set  of  Condition  Rating  Worksheets  (Method  2) 
Guidelines  for  Selecting  Conditions  (Method  2) 
Sample  Condition  Rating  Worksheet  (Method  2) 
Conditions  x  SPI's  Matching  Worksheet 
SPI  Summary  Worksheet 


CONDITION  RATING  WORKSHEET 


HRTGS 


CONDITION  RATING  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


2.  WEATHER:  TEMPERATURE 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


TEMPERATURE 


High  (specify) 


SYSTEM. 

NAME- 


.TEST _ DATE. 

.TELEPHONE _ 


CONDITION  RATING  WORKSHEET 


HRT€S 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


3.  WEATHER: 


PRECIPITATION 

SELECTED  SYSTEM  PERFORMANCE  ISSUES 


PRECIPITATION 


Ra  i  n 


Fog 


Falling/Blowing  Snow 


S  I  eet 


Sand  Storm 


No  Precipitation 


Other  (specify) 


CONDITION  RATING  WORKSHEET 


HRTGS 


WIND 

High  Head  Wind  (specify) 


Significant  Swirling  Wind  Gusts 
Cross  Wind  (specify) 


CONDITION  RATING  WORKSHEET 


HRTeS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY  1 


5.  WEATHER:  HUMIDITY 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


HUMIDITY 


High  (specify) 


CONDITION  RATING  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


6.  TERRAIN:  GROUND  SLOPE 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


GROUND  SLOPE 


SYSTEM. 

NAME- 


.TELEPHONE. 


.*•  *_A 


HRTGS 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


7.  TERRAIN:  GROUND  SURFACE 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


GROUND  SURFACE 


Sandy 


Rocky 

Loam  (Deep  Soil) 

Paved  (specify  type  and  carrying  level) 


Broken  Paved 


Broken  Ground 


Plowed  Fields 


Bare  Packed 


Vegetation  Covered 
Other  (specify) 


SYSTEM. 

NAME-. 


.TEST _ DATE. 

.TELEPHONE _ 


CONDITION  RATING  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


8.  TERRAIN:  GROUND  AND  WATER  SURFACE 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


GROUND  AND  WATER  SURFACE 


Light  Mud 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


9.  TERRAIN;  OBSTACLES 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


OBSTACLES 


Dense  Vegetation 
Light  Vegetation 
Hedge  Rows 

Rivers  (specify  depth,  width) 


Manmade  Structures  (specify) 


Traps  (specify) 


No  Obstacles 


Other  (specify) 


SYSTEM. 

NAME-. 


.TELEPHONE. 
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CONDITION  RAiiNG  WORKSHEET 


HRT€S 


CONDITION  RATING  WORKSHEET 


HRT€5 

^^^^^^SYSTEMFUN^ 


SYSTEM  FUNCnON 

1  CONDITION  CATEGORY 

1 

n.  TARGET:  NUMBER  | 

SELECTED  SYSTEM  PERFORMANCE  ISSUES  | 

NUMBER 

■ 

Single  Target 

HI 

Multiple  Simultaneous  Targets  (specify) 

■ 

■ 

Multiple  Sequential  Targets  (specify) 

|H 

H 

Combination  of  Multiple  Simultaneous 
and  Multiple  Sequential  Targets  (specify) 

Noise  -  Number/^  of  Targets  Within  Nontarget 
Background  (specify) 

Other  (specify) 

1 

SYSTEM 

.TEST_ 

_ DA 

JE 

_PAGC 

NAME - - - TELEPHONE 


W4-12 


CONDITION  RATING  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


12.  TARGET:  LOCATION 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


LOCATION 


Minimum  Range  (specify) 


Azimuth  and  Elevation  Target  (specify) 


CONDITION  RATING  WORKSHEET 


HRT€S 


CONDITION  RATING  WORKSHEET 


HRTeS 


DIRECTION  OF  MOTION 
Closing  (specify  angle) 


Other  (specify) 


HRTGS 


CONOmON  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


15.  TARGET:  CONCEALMENT 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


CONCEALMENT 


Concealed  by  Physical  Means  (specify) 


Concealed  by  Electronic  Means  (specify) 


SYSTEM. 

NAME- 


.TELEPHONE. 


W4-16 


*_j^  .*_»»  r 


-M  ■*•  ^N.\V  t.%  fcN.  J"r 


i 


! 

V 

V 

! 

I 

5 

I 


HRTGS  CONOmON  RATING  WORKSHEET 


SYSTEM  FUNCTION 

1  CONDITION  CATEGORY 

1 

16.  PERSONNEL:  WORKLOAD  I 

SELECTED  SYSTEM  PERFORMANCE  ISSUES  | 

WORKLOAD 

When  Personnel  are  only  performing  this  SPI 

When  Personnel  perform  all  activities  which 
might  occur  at  the  same  time  this  SPI  is 

being  performed  (specify) 

Other  (specify) 

SYSTEM. 

NAME. 


.TEST. 


.DATE. 


J»AG£ 


.TELEPHONE. 
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CONDITION  RATING  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


17.  PERSONNEL:  DURATION  OF  PRECEEDING  WORK 

SELECTED  SYSTEM  PERFORMANCE  ISSUES 


DURATION  OF  PRECEEDING  WORK 


Fol lowing  No  Work 


HRTGS 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


18.  PERSONNEL;  PROTECTIVE  GEAR 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


PROTECTIVE  GEAR 


While  wearing  applicable  protective  clothing/ 
gear  (specify) 


While  wearing  normal  clothing/gear  (specify) 


SYSTEM 


TELEPHONE 


CONDITION  RATING  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


19:  PERSONNEL:  PHYSICAL  STRENGTH 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


PHYSICAL  STRENGTH 


With  Personnel  With  Minimum  Strength 


With  Personnel  With  Normal  Strength 


With  Personnel  With  Optimum  Strength 


Other  (specify) 


HRTES 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


20:  PERSONNEL:  PERCEPTUAL  ABILITY 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


PERCEPTUAL  ABILITY 


With  Personnel  With  Minimal  Perceptual 
Abi  I  itv(s)  (sDeci fv) 


CONDITION  RATING  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


21:  PERSONNEL:  EXPERIENCE 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


EXPERIENCE 


With  Personnel  With  Minimum  Experience 
(sped  fy ) 


HRTeS 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


22:  PERSONNEL:  APTITUDES 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


APTITUDES 


With  Personnel  With  Minimum  Applicable 
Aptitudes  (specify) 


With  Personnel  With  Normal  Applicable 
Aptitudes  (specify) 


With  Personnel  With  Optimum  Applicable 
Aptitudes  (specify) 


SYSTEM 


TELEPHONE 


l.-S.  .%  .s 


V  ^ 


J 
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CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


23:  PERSONNEL:  PHYSICAL  SIZE 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


PHYSICAL  SIZE 


With  Personnel  of  Minimum  Size  (specify) 


With  Personnel  of  Normal  Size  (specify) 


With  Personnel  of  Maximum  Size  (specify) 


SYSTEM. 

NAME- 


.TELEPHONE. 


W4-24 


CONDITION  RATING  WORKSHEET 
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HRTeS 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


25:  TRAINING:  LATENCY 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


LATENCY 


Following  a  Period  of  Time  Without  Specific 
Training  or  Practice  (specify) 


I mmed i ate  I y  Following  Training 


With  the  Normal  Period  of  Latency  (specify) 


HRTES 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCnON 


CONDITION  CATEGORY 


26:  TRAINING:  TEAM  VS.  INDIVIDUAL 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


TEAM  VS.  INDIVIDUAL 


With  Personnel  Who  Have  Had  Only  Individual 
Training 


With  Personnel  Who  Have  Had  Only  Team  Training 


With  Personnel  Who  Have  Had  a  Combination  of 
Team  and  Individual  Training  (specify) 


HRT€S  CONDITION  RATING  WORKSHEET 


CONDITION  RATING  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


28:  OPERATIONAL:  HARDWARE 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


HARDWARE 


With  Hardware  Fully  Up 


With  Partial  Breakdown  (specify) 


SYSTEM. 


NAME. 


.TELEPHONE. 


W4-29 


HRT6S 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


29:  OPERATIONAL;  INFORMATION  INPUTS 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


INFORMATION  INPUTS 


With  Full  Information  Inputs 


With  Partial  Information  Inputs  (specify) 


SYSTEM 


TELEPHONE. 


HRTGS 


GUIDELINES  FOR  DETERMINING 
TACTIC  CONDITIONS 


Tactics  as  Conditions:  Army  systems  are  employed  according  to  the  esta¬ 
blished  tactics  and  doctrine  at  a  specific  time.  Tactical  conditions  to 
be  exercised  in  the  field  test  will  be  those  most  significant  for  the  SPI 
under  investigation.  It  is  not  possible  for  this  Workbook  to  list  all 
tactics  for  Army  systems  now  and  in  the  future.  To  deal  with  the  question 
of  tactics,  two  alternatives  are  presented. 

(1)  It  is  preferab le  to  obtain  a  list  of  probable  tactics  for  the  system 
from  the  appropriate  Combat  Development  Center  experts;  analyze  it  into  a 
format  similar  to  that  on  Page  W4-33,  and  then  treat  the  resulting  tactical 
conditions  in  the  same  manner  as  all  other  conditions.  A  blank  Tactical 
Conditions  Worksheet  is  provided  for  this  purpose  (page  W4-32). 

(2)  If  necessary,  the  Tactics  Worksheets  (pages  W4-33  through  W4-40)  may 

be  used  directly  to  rate  tactics  as  conditions  for  each  SPI.  These  Worksheets 
may  be  incomplete  for  a  number  of  system  types,  and  for  this  reason  we 
suggest  that  these  Tactics  Worksheets  be  used  only  as  examples. 


CONDITION  RATING  WORKSHEET 


CONDITION  RATING  WORKSHEET 


HRT€S 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


31:  TACTICS:  NUMBER  OF  SYSTEMS  EMPLOYED _ 

SELECTED  SYSTEM  PERFORMANCE  ISSUES 


NUMBER  OF  SYSTEMS  EMPLOYED 


Single  System 


Multiple  System  of  Same  Type  (specify) 


Multiple  Systems  of  Different  Types  (specify 
types  and  numbers) 


CONDITION  RATING  WORKSHEET 


HRTGS 


Stationary 
Other  (specify) 


CONDITION  RATING  WORKSHEET 


HRTes  CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 

1  CONDITION  CATEGORY 

1 

34:  TACTICS:  DIRECTION  OF  MOTION  I 

SELECTED  SYSTEM  PERFORMANCE  ISSUES  | 

DIRECTION  OF  MOTION 

Closing  (specify  angle) 

Retreating  (specify  angle) 

Crossing  (specify  angle) 

Complex  Maneuver  (specify) 

Other  (specify) 

L 

J 

SYSTEM 

NAME- 


-“I’."' 


_ TEST _ DATE _ PAGE 

_ TELEPHONE _ 

W4-36 
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HRTES 


CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


35:  TACTICS:  CONCEALMENT 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


CONCEALMENT 


Concealed  by  Physical  Means  (specify) 


Concealed  by  Electronic  Means  (specify) 


CONDITION  RATING  WORKSHEET 


HRTES 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


36:  TACTICS:  CREW  PROTECTION 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


CREW  PROTECTION 


Crew  Fully  Protected-Buttoned  Up 


Crew  Partially  Protected  (specify) 


Crew  in  Least  Protected  Configuration 
(spec i fy ) 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


37:  TACTICS:  AMOUNT  OF  AUTOMATIC  FUNCTIONING 

SELECTED  SYSTEM  PERFORMANCE  ISSUES 


AMOUNT  OF  AUTOMATIC  FUNCTIONING 


Fully  Automatic 


Semi-Automatic  (specify) 


SYSTEM. 

NAME- 


.  TELEPHONE. 


W4-39 
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CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATEGORY 


38:  TACTICS:  SYSTEM  WORKLOAD 


SELECTED  SYSTEM  PERFORMANCE  ISSUES 


SYSTEM  WORKLOAD 


Overloaded  (specify) 


100$  Loaded  (by  weight  or  volume) 


Operationally  Loaded  (specify) 


SYSTEM. 

NAME- 


.TELEPHONE. 


W4-40 
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CONDITION  RATING  WORKSHEET 
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GUIDELINES  FOR  SELECTING 
CONDITIONS 


This  package  of  worksheets  consists  of  "Condition  Rating  Worksheets"  and 
the  Guidelines  which  you  are  reading  now.  You  are  asked  to  assist  in  the 
selection  of  conditions  under  which  the  "System  Performance  Issues" 
(SPI’s)  will  be  tested. 

Your  role  is  to  rate  the  criticality  of  the  conditions  for  each  of  the 
SPI's  listed  while  considering  the  System  Function  associated  with  each. 
Based  on  your  and  other  expert's  ratings,  the  most  critical  conditions 
will  be  picked  and  combined  with  the  appropriate  SPI's  to  yield  more 
specific  SPI's.  This  procedure  will  insure  that  the  Operational  Test 
will  be  conducted  in  those  conditions  which  are  critical  concerns  for 
the  system. 

The  rating  procedure  has  two  phases.  In  the  first  phase  you  will  rate 
the  relevant  categories  on  a  3-point  criticality  scale  for  each  of  the 
SPI's.  In  the  second  phase  you  will  rate  the  conditions  within  each  of 
the  categories  on  the  same  scale  for  each  of  the  SPI's. 

You  are  not  being  asked  to  rate  the  conditions  on  specific  attributes 
of  criticality,  but  rather  on  one  overall  scale  of  criticality.  It  is 
suggested  that  you  keep  in  mind  the  following  dimensions  when  you  make 
thi s  overa I  I  rati ng : 

(a)  The  extent  to  which  the  system  is  designed  specifically 
to  perform  the  given  SPI  as  part  of  the  System 
Function  in  this  condition. 


HRTGS 


GUIDELINES  FOR  SELECTING 
CONDITIONS  (Continued) 


(b)  The  extent  to  which  this  condition  is  likely  to 
negatively  affect  the  system's  ability  to  perform 
the  SPI  as  part  of  the  System  Function. 

(c)  The  extent  to  which  this  condition  has  already  been 
associated  with  inadequate  performance  of  the  given 
SPI — either  during  prior  OT's/DT's  or  in  similar 
systems  in  the  field. 

(d)  The  amount  or  number  of  times  the  given  SPI  will  be 
performed  under  this  condition  as  part  of  the  System 
Function. 

The  following  are  instructions  for  rating  the  conditions  for  each  of 
the  SPI’s: 

(I)  Examine  the  "Condition  Rating  Worksheets"  and  rate  each 
condition  category  on  the  following  3-point  scale  of 
criticality.  Do  this  for  each  SPI.  A  category  might  be 
rated  differently  for  different  SPI’s. 


0  I  2 

Irrelevant  Relevant,  Relevant, 

but  not  critical  and  very  critical 

Use  the  "2"  Rating  sparingly!  Only  the  most  critical 
categories  should  be  so  designated.  Condition  categories 
rated  "I"  will  also  be  included  in  the  field  test,  but 
only  those  rated  "2"  will  become  part  of  the  SPI. 


V 
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GUIDELINES  FOR  SELECTING 
CONDITIONS  (Continued) 


NOTE:  The  same  SPI  may  occur  under  different  System  '^unctions,  and 
your  rating  may  be  different  in  each  occurrence. 

(2)  Record  your  ratings  in  the  appropriate  boxes  on  the 
worksheets.  (See  the  "Sample  Condition  Rating  Worksheet.") 
After  completing  this,  each  of  the  boxes  at  the  inter¬ 
section  of  the  SPI's  and  the  category  names  will  have 
either  "C,"  "1 or  "2." 

(3)  Each  SPI  now  has  relevant  (rated  "I"  or  "2")  and  irrelevant 
(rated  "0")  categories.  For  each  SPI,  rate  and  record  each 
specific  condition  within  its  relevant  categories  (i.e., 
those  categories  rated  "I"  or  "2")  on  the  same  scale  as 
used  above. 


(4)  Return  the  completed  rating  Worksheets  to  the  sender. 
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CONDITION  RATING  WORKSHEET 


SYSTEM  FUNCTION 


CONDITION  CATECOKY  I 


t.  WEATHER:  ILLUMINATION 

SELECTED  SYSTEM  PERFORMANCE  ISSUES 


1  LL'JN 

MNAT 

ION 

*u  ’  I 

Sun  i 

'  ght 

Moon  1 

i  ght 

Star  1 

1  gnt 

Cusk 

Cverc 

as*, 

Moonless  Night  (oi^ch  Slack) 

( soec i ty) 

■O' 

"  '  sr«s 


0 1 r»ct  Glare 


Indirect  Glare  (Water,  Sand,  Clouds,  etc.) 


Other  (soecify) 


SYSTEMS 

NAME_ 


h^st^ESoate: 

.TELEPHONE _ 
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SAMPLE 


HRTGS 


CONDITION  RATING  WORKSHEET  - 
METHOD  2 


WEATHER 


ILLUMINATION _ 

Ful I  SunI ight 
Moon  I ight 
Starl i ght 
Dusk 

Pitch  Black 

Artificial  Light  (specify) 
Flares 

Di rect  Glare 
I ndi rect  Glare 
As  Occurs 
Other  (specify) 


.  TEMPERATURE 


High  (specify) 


Low  (specify) 


Normal  (specify) 


As  Occurs 
Other  (specify) 


PRECIPITATION _ 

Rain 

Fog 

Falling/Blowing  Snow 
S I  eet 

Sand  Storm 
No  Precipitation 
As  Occurs 
Other  (specify) 


4.  WIND 


High  Head  Wind  (specify) 

High  Tail  Wind  (specify) 

Swirl ing  Gusts 
Cross  Wind  (specify) 

No  Wind 
As  Occurs 
Other  (specify) 


5.  HUMIDITY 


High  (specify) 


Low  (specify) 


Normal  (specify) 


As  Occurs 
Other  (specify) 


[iljli] 


law 


SYSTEM 


TERRAIN 


6.  GROUND  SLOPE 


Flat  (specify) 


Low  Pos i t i ve  Hilly 
(speci fy) 


Low  Negative  Hilly 
(specify) 


High  Positive  Mountain 
(specify) 


High  Negative  Mountain 
(speci fy) 


As  Occurs 


Other  (specify) 


GROUND  SURFACE 


Sandy 

Rocky 


Paved 


Broken  Paved 


Broken  Ground 


Plowed  Fields 


Bare  Packed 


Vegetation  Covered 


As  Occurs 


Other  (specify) 


GROUND  +  WATER 


Light  Mud 
Heavy  Mud 
Dry 


Water  Covered 


Ice  Covered 


Snow  Covered 


As  Occurs 


Other  (specify) 


OBSTACLES 


Dense  Vegetation 
Light  Vegetation 
Hedge  Rows 

Rivers  Width  and  Depth 
Manmade  Structures  (specify) 


Traps  (specify) 


No  Obstacles 


As  Occurs 


Other  (specify) 


TELEPHONE- 
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CONDITION  RATING  WORKSHEET 
METHOD  2  (CONTINUED) 


TARGET 


10.  TYPE 


Type/Size  (specify) 


13.  SPEED 


Maximum  Speed  (specify) 


As  Occurs 
Other 


Minimum  Speed  (specify) 


Cruising  Speed  (specify) 


NUMBER _ 

Single  Target 

Multi  Simul  Targs 
(speci fy) 

Multi  Sequent  Targs 
(specify) 

Comb  Multi  Simul  + 
Sequent  (specify) 


Noise  -  Targef/Nonfarget 
Ratio  (specify) 


As  Occurs 
Other  (specify) 


12.  LOCATION 


Minimum  Range  (specify) 


Maximum  Range  (specify) 


Normal  Range  (specify) 


Azimuth  +  Elevation 
(speci fy) 

As  Occurs 
Other  (specify) 


Rad  Alter  of  Speed  (specify) 


Stationary 
As  Occurs 


Other  (specify) 


14.  DIRECTION _ _ 

Closing  (specify  angle) 

Retreating  (specify  angle) 


Crossing  (specify  direction 
and  angle) 


Complex  Maneuver  (specify) 


As  Occurs 
Other  (specify) 
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CONDITION  RATING  WORKSHEET 
METHOD  2  (CONTINUED) 


S'!! 

• 


I 


I 


I 


I 


,  p 

v'j 


■f. ' 


•f.' 

V  ■ 
■ 


NAME 


.TELEPHONE 


W4-50 
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CONDITION  RATING  WORKSHEET  - 
METHOD  2  (CONTINUED) 


PERSONNEL 


16.  WORKLOAD 

— 

Full  Operat  Loading 

Partial  Operat  Loading 
(speci fy) 

As  Occurs 

Other  (specify) 

17.  WORK  DURATION 

Fol lowing  no  Work 

Foliowing  Extended  Work 
(specify) 

Foil  owing  Normal  Work 
(specify) 

As  Occurs 

Other  (specify) 

□ 

18.  PROTECT  GEAR 

1 

1 

■ 

■ 

Wearing  Protect  Gear 
(speci fy) 

Wearing  Normal  Gear 
(specify) 

As  Occurs 

Other  (specify) 

19.  STRENGTH 

— 

Minimum  Strength 

Norma i  Strength 

Optimum  Strength 

As  Occurs 

Other  (specify) 

20.  PERCEPTION 

— 

Minimum  Perception 

Normal  Perception 

Optimum  Perception 

As  Occurs 

Other  (specify) 

□ 

21.  EXPERIENCE 

1 

1 

1 

■ 

■ 

Minimum  Experience  (specify) 

Normal  Experience  (specify) 

Optimum  Experience  (specify) 

As  Occurs 

Other  (specify) 
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CONDITION  RATING  WORKSHEET 
METHOD  2  (CONTINUED) 


TRAINING 

MEB 

INSTITUTION 

OJT-Trained 

School -Trained 

Comb  OJT  +  School 

No  Specific  Training 

Factory-Tra i ned 

As  Occurs 

Other  (specify) 

25. 

LATENCY 

■H 

Period  W/O  Train ing/Prac 

(speci fy) 

■H 

Immed  After  Training 

Normal  Latency  (specify) 

As  Occurs 

y| 

Other  (specify) 

tss 

TEAM  VS  INDIV 

Only  Indiv  Training 

Only  Team  Training 

Comb  of  Indiv  +  Team 

(specify) 

■■ 

As  Occurs 

Other  (specify) 

SYSTEM. 

NAME- 


.TEST _ DATE. 
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CONDITION  RATING  W( 
METHOD  2  (CONTINUL-. 


OPERATIONAL 


27.  CREW _ 

Optimum  Crew  (specify) 

Normal  Crew  (specify) 

Minimum  Crew  (specify) 

As  Occurs 
Other  (specify) 


28.  HARDWARE _ 

Fully  Up 

Partial  Breakdown  (specify) 


Fully  Down 
As  Occurs 
Other  (specify) 

29.  INFORMATION  INPUTS 

Full  Information  Inputs 
Partial  Info  Inputs  (specify) 


No  Info  Inputs 
As  Occurs 
Other  (specify) 


V _ J 

SYSTEM _ _ _ TEST _ 

NAME  TElFPHnME 
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CONDITION  RATING  WORKSHEET 
METHOD  2  (CONTINUED) 


TACTICS 


30.  TACTICS 


33.  LXATION(S) 


Specify  Tactlc(s)  or  Rate 
Tactical  Conditions  (#*s 
31-38) 


Specify  Locatlon(s) 


34.  DIRECTION 


Closing  Angie  (specify) 


#  OF  SYSTEMS 


I 


Single  System 

Multiple  of  Same  Type 
(specify) 


Retreating  Angle  (specify) 


Crossing  Angle,  Direction 
(specify) 


Multiple  Systs  of  Olff 
Types  (specify) 


Complex  Maneuver  (specify) 


As  Occurs 


As  Occurs 


Other  (specify) 


Other  (specify) 


35.  CONCEALMENT 


32.  SPEED 


Maximum  Speed  (specify) 


Concea I ed  Phys leal  I y 
Concealed  Electronically 


(specify) 


Minimum  Speed  (specify) 


Partial ly  Concealed  (specify) 


Cruising  Speed  (specify) 


Rad  Alter  of  Speed 
( spec  I fy ) 


Concealed  by  Smoke 
Unconcea I ed 


As  Occurs 


Stationary 
As  Occurs 
Other  (specify) 


Other  (specify) 


SYSTEM . 


NAME- 


-TELEPHONE. 


W4-55 


TACTICS  (CONTINUED) 


36.  CREW  PROTECTION 

Fully  Protected-But+oned 
Up 

Partially  Protected  Config 
(specify) 

Least  Protected  Config 
(specify) 

NBC  Conditions 
As  Occurs 
Other  (specify) 


37.  AUTOMATIC  FUNCTION 
Fully  Automatic 
Semi-Automatic  (specify) 

Manual  Mode 
As  Occurs 
Other  (specify) 


38.  SYSTEM  LOADING 

Overloaded 

100$  Loaded  (WT/VOL) 

Operationally  Loaded 
(speci fy) 


Unloaded 
As  Occurs 
Other  (specify) 
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GUIDELINES  FOR  SELECTING  CONDITIONS 
METHOD  2 


This  package  consists  of  "Condition  Rating  Worksheets  -  Method  2"  and  the 
Guidelines  that  you  are  now  reading.  Also  Included  Is  a  copy  of  the  "Descrip¬ 
tion  of  the  System  to  be  Tested,"  several  "System  Function  Worksheets,"  and  a 
"System  Performance  Issue  Worksheet."  These  additional  pages  describe  the 
system  that  Is  to  be  tested  during  the  Operational  Test  (OT)  and  list  the 
System  Functions  and  System  Performance  Issues  that  have  already  been  identi¬ 
fied  for  this  system.  Refer  to  these  pages  to  refresh  your  memory  of  the  items 
being  Included  in  the  test  and  the  Issues  that  are  to  be  evaluated. 

You  are  asked  to  assist  In  selecting  the  conditions  under  which  the  system 
will  be  tested  during  the  OT.  Your  role  Is  to  rate  the  criticality  of  the 
conditions  for  the  performance  and  maintenance  of  the  system. 

Some  conditions  may  be  so  important  for  this  particular  system  that  these 
conditions  should  be  stated  explicitly  as  part  of  the  Issues  upon  which  the 
test  Is  planned  and  conducted.  Other  conditions  may  be  Important  for  a 
thorough  assessment  of  the  system,  but  they  need  not  be  stated  explicitly  In 
the  Issues.  Finally,  some  conditions  will  be  left  uncontrolled  to  vary  "as 
occurs"  during  the  test.  Your  ratings  will  help  to  determine  how  the  con¬ 
ditions  will  be  treated  in  the  test. 

Some  of  the  condition  categories  or  individual  conditions  within  a  category 
may  have  been  crossed  out.  In  this  case,  it  has  already  been  determined  either 
that  they  are  not  within  the  charter  of  the  testing  agency  to  specify  these 
conditions,  or  that  these  conditions  will  be  left  uncontrolled  to  vary  "as 
occurs."  You  may  simply  Ignore  these  "crossed-out"  conditions. 


The  rating  procedure  has  two  parts.  In  the  first  part,  you  will  rate  the 
condition  categories  on  a  3-point  scale  of  criticality.  In  the  second  part, 

I 

you  will  rate  the  individual  conditions  within  each  category.  In  this  second 
part,  you  will  use  two  of  three  points  on  the  same  3-point  rating  scale. 


SYSTEM . 


NAME- 


-TELEPHONE, 


W4-58 


*.  •'*- 


GUIDELINES  FOR  SELECTING  CONDITIONS  - 
METHOD  2  (CONTINUED) 


HRTGS 


Rather  than  asking  you  to  rate  these  condition  categories  and  individual  condi¬ 
tions  along  several  attributes  of  criticality,  you  are  asked  to  rate  on  a 
single  attribute.  However,  it  is  suggested  that  you  keep  in  mind  the  following 
four  dimensions  when  you  make  your  ratings  of  both  the  condition  categories 
and  the  individual  conditions: 

(1)  The  amount  or  number  of  times  the  system  will  perform  or  be 
maintained  under  this  condition. 

(2)  The  extent  to  which  the  system  is  designed  specifically  to  perform 
or  be  maintained  under  this  condition. 

(3)  The  extent  to  which  this  condition  is  likely  to  negatively  affect 
the  performance  or  maintenance  of  the  system. 

(4)  The  extent  to  which  this  condition  has  already  been  associated 
with  inadequate  performance  or  maintenance,  either  in  prior  tests 
of  this  system,  or  In  significantly  similar  systems  that  have 
already  been  fielded. 

Use  the  following  instructions  to  rate  the  condition  categories  and  the  indi¬ 
vidual  conditions  wl+hin  each  category: 

(1)  Examine  the  "Condition  Rating  Worksheets  -  Method  2"  and  rate  each 
condition  category  on  the  following  3-point  scale: 

0  -  Not  critical .  This  conditior  will  be  left  uncontrolled 
.  to  vary  "as  occurs"  during  the  test. 

1  -  Important.  This  condition  should  be  controlled  during 
the  test,  but  is  not  so  critical  that  it  need  be  stated 
explicitly  as  part  of  an  Issue.  , 


SYSTEM 


NAME 
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2  -  Critical .  This  condition  is  sufficiently  critical  to  a 
thorough  evaluation  of  the  system  that  the  test  must  be 
structured  explicitly  to  include  this  condition.  This 
condition  will  be  stated  explicitly  as  part  of  an  Issue. 

Use  the  "2”  rating  sparingly!  To  rate  a  condition  category  as  "2" 
gives  great  importance  to  that  condition  and  highlights  its  visi¬ 
bility  throughout  the  test  planning  and  execution.  Also,  as  a 
practical  matter,  every  time  you  rate  a  condition  as  "2"  you  may 
increase  the  number  of  Issues. 

Rating  a  condition  category  as  "1"  may  be  sufficient  to  flag  that 
condition  as  worthy  of  attention.  Conditions  rated  "1"  will  be 
controlled  during  the  test. 

(2)  Rate  the  individual  conditions  that  belong  to  those  categories  that 
you  rated  either  "1"  or  ”2."  It  is  not  necessary  to  rate  conditions 
for  categories  rated  "0." 

For  categories  that  you  have  rated  "2, ''  individual  conditions  may  be 
rated  either  "0"  or  "2,"  on  the  original  rating  scale.  They  may  not 
be  rated  "1."  For  each  condition  category  rated  "2,"  at  least  one 
individual  condition  must  be  rated  "2."  However,  any  number  of 
conditions  in  that  category  may  be  rated  "2,"  as  long  as  at  least 
one  is  so  rated.  You  should  continue  to  be  sparing  in  your  use  of 
the  "2"  rating.  However,  you  should  be  aware  that  an  individual 
condition  which  you  rate  "0"  in  a  category  rated  "2"  will  not  be 
used  in  the  field  test.  Therefore,  if  you  have  rated  a  category 
"2,"  and  If  you  want  a  "normal"  or  "as  occurs"  condition  in  that 
category  to  be  used  for  this  system,  you  will  have  to  rate  the 
"normal"  or  "as  occurs"  condition  as  "2,"  otherwise  they  will  not 
appear  In  the  field  test. 
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For  categories  that  you  have  rated  "1 individual  conditions  may  be 
rated  either  "0,"  or  *'1”  on  the  original  rating  scale.  Rating  an 
individual  condition  "1"  in  a  category  rated  "1,"  means  that  you  do 
not  want  this  condition  added  to  an  issue,  but  you  feel  that  it 
should  be  used  in  the  field  test. 

When  you  have  completed  your  ratings,  fill  in  your  name  and  tele¬ 
phone  number  at  the  bottom  of  each  Worksheet,  and  return  them  to 
the  sender. 
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CONDITIONS  X  SPI  MATCHING 
WORKSHEET 


r 

SYSTEM 
FUNCTION  # 

SPI  # 

I,  WEATHER:  ILLUMINATION 


Full  Sunlight 


Moon  I ight 


Star  I Ight 


Dusk 


Pitch  Black 


Artificial  Lighting 


Flares 


Dl rect  Glare 


Indirect  Glare 


As  Occurs 


.  WEATHER:  TEMPERATURE 


High 


Low 


Normal 


As  Occurs 


.  WEATHER:  PRECIPITATION 


Rain 


Fog 


Falling/Blowing  Snow 


Sleet 


Sand  Storm 


No  Prec i p i tat  I on 


As  Occurs 


.  WEATHER:  WIND 


High  Head  wind 


High  Tai I  Wind 


Swirling  Gusts 


Cross  wind 


No  Wind 


As  Occurs 


.  WEATHER:  HUMIDITY 


High 


Low 


Normal 


As  Occurs 
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CONDITIONS  X  SPl  MATCHING 
WORKSHEET  ( CONT I NUED ) 
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CONDITIONS  X  SPI  MATCHING 
WORKSHEET  (CONTINUED) 


r 

SYSTEN 
FUNCTION  « 

SPI  8 

16.  PERSONNEL:  NORKU3AO 


Pull  Oparat  Loading 


Parrlal  Oparat  Loading 


Aa  Occurs 


17.  PERSONNEL:  WORK  0URAT10N 


Pel  losing  No  work 


Pol  lowing  Extandad  Work 


Pol  lowing  Moraal  Work 


Aa  Oceun 


18.  PERSONNEL:  TOTECT  SEAR 


Wearing  Protaet  Saar 


Wearing  Noraal  Saar 


Aa  Occurs 


STRENGTH 


Mlnfaua  StrangrP 


Normal  Strangtfi 


Opriauai  StrongTti 


As  Occurs 


Mlniflnaa  Parcaptlon 


Normal  Parcaptlon 


Optlimmi  Parcaptlon 


Aa  Occurs 


1.  PERSONNEL:  EXPERIENCE 


Mlnlimai  Exparianea 


Normal  Exparianea 


Optlimai  Exparianea 


As  Occurs 


.  PERSOWEL:  APTITIJOES 


Mtnimui  Aptltudas 


Normal  Aptltudas 


Ootimia*  Aptltudas 


As  Occurs 


.  PERSONNEL:  SIZE 


Wlninui  SIzs 


Nonnai  siza 


Maxlmui  SIza 


As  Occurs 
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CONDITIONS  X  SPI  MATCHING 
WORKSHEET  (CONTINUED) 


r 

SYST04 
FUNCTION  » 

SPI  $ 

24.  TRAINING;  INSTITUTION 

OJT-Trained 

School  Trained 

Como  OJT  +  School 

No  Spec  Training 

Factory-T  ra 1 ned 

As  Occurs 

25.  TRAINING:  LATENCY 

“  ”  1 

Period  W/0  Tra 1 n i ng/Prac 

1  limed  After  Training 

Norma  1  Latency 

As  Occurs  1 

26.  TRAINING:  TEAM  VS  INDIV 

Only  Indiv  Training 

Only  Team  Training 

Comp  of  Indiv  t  Team 

As  Occurs 

>  -1,  ~.l  1  — I.  ■—  . . . 

<  ^  J*  V  VW  wii 
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CONDITIONS  X  SPI  MATCHING 
WORKSHEET  (CONTINUED) 


r 

SYSTEM 
FUNCTION  1 

SPI  « 

30.  TACTICS 


31.  TACTICS:  I  OF  SYSTEMS 


Single  System 


Multiple  of  Same  Type 


Multiple  Systs  of  01 ff  Types 


As  Occurs 


32.  TACTICS:  SPEED 


Maximum  Speed 


Minimum  Speed 


Cruising  Speed 


Rad  Alter  of  Speed 


Stationary 


As  Occurs 


33.  TACTICS:  LOCATIONCS) 


34.  TACTICS:  DIRECTION 


Closing  Angie 


Retreating  Angle 


Crossing  Angle,  Direction 


Complex  Maneuver 


As  Occurs 


35.  TACTICS:  CONCEALMENT 


Concealed  Physically 


Concea led  El ectron I ca 1 1 y 


Partial ly  Concealed 


Concealed  by  Smoke 


Unconcealed 


As  Occurs 


SYSTEM. 
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CONDITIONS  X  SPI  MATCHING 
WORKSHEET  (CONTINUED) 


SYSTEM 

function  t 


16.  TACTICS 

CREW  PROTECTION 

1 

Fully  Protect*d-Button«d  Up 

Partially  Protactad  Config 

Least  Protected  Config 

NBC  Conditions 

As  Occurs 

37.  TACTICS 

AUTOMATIC  FUNCTION 

Fully  Automatic 

Sem i -Automat  1 c 

Manual 

Mode 

As  Occurs 

3a.  TACTICS 

SYSTEM  LOADING 

Overloaded 

I00<  Loaded  (tfT/VOL) 

Oparatlonal ly  Loaded 

Unloaded 

As  Occurs 
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CONDITIONS  X  SPI  MATCHING 
WORKSHEET  (CONTINUED) 


SPt  SUMMARY  WORKSHEET 


HRTES 


SPI  (STATEMENT) 


SELECTION 

WEIGHT 


CONDITION  COMBINATIONS 
AnACHED  TO  SPI  STATEMENTS 


FINAL 

SELECTION 

WEIGHTS 


I  I  5.  HUMAN  PERFORMANCE  FUNCTION  GROUPS 

rlrC  I  (HPF-Groups) 


a 


CONTENTS 

1.  Set  of  Operational  HPF-Group  Worksheets 

2.  Guidelines  for  Developing  Maintenance  Human  Performance  Functio  (HPF's) 

3.  Maintenance  Worksheet 

4.  Test  Condition  Worksheet 

5.  Final  Condition  Set  Worksheet 

6.  Guidelines  for  Developing  Performance  Criteria 

7.  Sample  Criterion  Worksheet  (2  Pages) 

8.  Criterion  Worksheet 

9.  Guidelines  for  Developing  Statistics  and  Statistic  Criterion 

10.  Sample  Criterion  Worksheet  (2  Pages) 


HRTeS 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


1  WEAPON  DELIVERY 


.  Assemble  system 


2.  Emplace  system 


3.  Calibrate  system  components  including  boresighting  and  zeroing 


4.  Acquire  target(s)  (This  HPF  is  dealt  with  as  a  separate  HPF- 
Group.  Turn  to  page  W5-3 ,  to  complete  It.^ 


5.  Select  ammunition 


6.  Prepare  ammunition  for  firing 


7,  Communicate  fire  order  and  other  intracrew  instructions 


8.  Fire  weapon 


9,  Dispose  of  spent  casing(s) 


10.  Guide  weapon  to  target 


11.  Perform  misfire  procedure 


2.  Perform  hangfire  procedure 


3.  Clear/swab/clean  appropriate  sections  of  system 
14.  Disassemble  system 


SYSTEM . 
NAME- 


.TELEPHONE. 


MARK  IF  RELEVANT 


HRTGS 


OPERATIONAL  HPF-GROUP  WORKSHEET 


HPrt 


.  Detect  target (s) 


2.  Identify  target (s) 


3.  Select  target (s)  and  target  order 


.  Orient  weapon  system  in  general  firing  position 


5. 

Determine  range  of  target 

6. 

Aim  weapon  system.  This  involves  a  procedure  which 
system  being  adjusted  for  the  azimuth  and  elevation 

results  in  the 
of  the  target 

7. 

Illuminate  or  designate  target 

8. 

Adjust  aim,  following  miss 

9. 

Shift  to  second  target 

SYSTEM 

NAME- 


TEST _ DATE. 

TELEPHONE _ 


W5-3 


MARK  IF  RELEVANT 


OPERATIONAL  HPF-GROUP  WORKSHEET 


MAMi  TCIPPMOMK 


MARK  IF  RELEVANT 


HRT6S 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


WEAPON  DELIVERY-GROUND  TO  GROUND 
MISSILES  (CONTINUED) 


18.  Perform  missile  no-go  procedure 


19.  Perform  misfire  procedure 


20.  Perform  hangfire  procedure 


MARK  IF  RELEVANT 


HRT€S 


OPERATIONAL  HPF-GROUP  WORKSHEH 


SYSTEM  FUNCTION 


HPF-GROUP  rj 


4  WEAPON  DELIVERY— HAND  GRENADES 


Iv 

Inspect  grenade  for  defects 

2. 

Correct  applicable  defects 

3. 

Attach  to  appropriate  partCs)  of  person/harness/etc. 

4. 

Acquire  target;  include  the  judgment  of  distance 

to  target 

5. 

Aim  grenade 

6. 

Launch  grenade 

7. 

Adjust  launch  based  on  location  of  detonation  in 

relation  to  target 

MARK  IF  RELEVANT 


HRT€S 


OPERATIONAL  HPF-GROUP  WORKSHEH 


.  Select  appropriate  location  for  mine  installation 


2.  Inspect  mine/triggering  device/fusing  device 


.  Transport  mine 


.  Prepare  mine  for  installation 


5.  Install  mine  (including  the  digging  of  a  hole) 


6.  Camouflage  mine/triggering  device 


Aim  mine,  if  applicable 


Test  ci rcuit(s) 


Fire  mine,  if  applicable 


Disarm  mine 


SYSTEM. 

NAME- 


.  TELEPHONE. 


MARK  IF  RELEVANT 


HRT€S 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  I# 


TARGET  INFORMATION  GATHERING  AND 
I NTERPRETAT I  ON 


.  Assemble  system 


2.  Position  system  in  appropriate  location 


3.  Select  type  and  number  of  sensors 


.  Position  sensors  in  appropriate  location 


5.  Calibrate/align  system  components 


6.  Detect  target(s) 


7.  Identify  target(s) 


8.  Determine  number  of  targets 


9.  Determine  target (s)  locat ion/range 


10.  Determine  target  speed 


11.  Determine  target  direction 


12.  Determine  target  formation/tactical  situation 


13.  Select  and  order  targets  based  on  the  matching  of  priorities  with 
target  information  gathered. 


14.  Recognize  countermeasures  and  take  appropriate  action 


MARK  IF  RELEVANT 


OPERATIONAL  HPF-GROUP  WORKSHEET 


1.  Assemble/disassemble  system 

2.  Calibrate/align  system 

3.  Select  designator  system  position 


Acquire  target  (See  Target  Acquisition,  page  W5-3. ) 


MARK  IF  RELEVANT 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


8  TARGET  BEHAVIOR  PREDICTION 


<  2 
UJ  ^ 


I  z 


.  Predict  maneuver  of  target(s) 


2.  Predict  location  of  target(s)  after  given  time  interval,  or  predict 
time  interval  to  arrive  at  given  location  (location  includes  range 
altitude,  azimuth,  elevation,  etc.) 


3.  Predict  attack  of  target(s)  on  friendly  force 


.  Predict  t i me/ I ocat i on  for  successful  attack  on  target (s) 


SYSTEM. 

NAME-. 


.TELEPHONE. 


W6-10 


.  *Y,.-  •  .1 


OPERATIONAL  HPF-GROUP  WORKSHEET 


1 


I 

j 

w 

\ 

I 

i 

<1 

I 

i 

I 


HRTGS 


SYSTEM  FUNCTION 

SPI 

HPF-GROUP 

HPF^ 

*  ^ 

9  WEAPON  FUNCTION  MANAGEMENT  5  S 

5  « 

-  ^  2 

Si  = 
at  ^ 

it  S: 

1  z 

1.  Determine  type  of  target 

1 

■ 

2.  Determine  speed/direction  of  target 

■ 

■ 

3.  Determine  target  range  at  time  of  weapon  delivery 

1 

■ 

4.  Determine  weather  conditions  which  impact  weapon  delivery  and  adjusf 
for  them 

1 

■ 

5,  Determine  type  of  ammunition  to  be  used  based  on  al 1  above  factors 

1 

■ 

6.  Determine  probable  amount  of  ammunition  required  to  kill  target 
under  existing/projected  conditions 

1 

■ 

7.  Recommend  action  based  on  available  supply  of  ammunition,  future 
probable  requirements  for  ammunition,  and  probable  required  amount 
to  kill  target  at  various  ranges/speeds 

1 

1 

1 

■ 

1 

■ 

1 

i 

1 

■ 

1 

■ 

L_  .. 

1 

■ 

■ 

a 

SYSTEM _ TEST _ DATE _ PAGE 

NAME  - - TELEPHON  E _ 


W5-11 


HRT€S 


OPERATIONAL  HPF-GROUP  WORKSHEH 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


REPRESENTATION  OF  TERRAIN/OBSTACLES/ 
I NSTALLAT I ONS/WEATHER 


1.  Indicate  key  terrain  features  which  might  affect  outcome  of  the 
operation^ 


2.  Indicate  man-made  obstacles  which  might  affect  the  outcome  of  the 
operat i on^ 


3.  Indicate  installations  which  might  affect  the  outcome  of  the 
operat ion3 


4.  Indicate  features  of  weather  which  might  affect  the  outcome  of  the 
operation^ 


5.  Identify  important  information  which  is  missing 


6.  Identify  important  information  which  is  internally  inconsistent 
or  probably  inaccurate 


Develop  alternate  information  sources 


8.  Prioritize  information  according  to  user(s)  need  and  probability 
of  its  accuracy 


9.  Prioritize  list  of  information  users  for  receipt  of  information 
based  on  their  functions  in  this  specific  operation  and  their 
requ i rements 


n 


1,  2,  3,  4 


See  page  W5-13  for  footnotes 


MARK  IF  RELEVANT 


HRTGS 


FOOTNOTE  FOR  OPERATIONAL 
HPF-GROUP  WORKSHEET 


REPRESENTATION  OF  TERRA  1 N/OBSTACLES/ 1 NSTALLAT I ONS/WEATHER 


Your  consideration  of  terrain 


features  should 


include  the  following: 


coastline  configuration 
exits  from  beaches 
avenues  of  approach 
cover  and  concealment 
observation  and  fields  of  fire 
defiladed  areas 

areas  suitable  for  avaiation  landi 
positions  for  weapons 
spaces  for  maneuver 
points  of  maximum  disruption 


soil  composition 
water  depth 
terrain  slopes 
beach  characteristics 
elevations 

accessibility  of  terrain  features 

ng 


Your  consideration  of 


man-made  obstac  les  shou I d 


include  the  following: 


mi  nef iel ds 
tank  traps 
water  obstacles 
ditches 

destroyed/potentially  destroyed  bridges,  tunnels,  etc. 


^Your  consideration  of  installations  should  include  the  following: 


enemy  air  defense  systems 
enemy  radar  facilities 
enemy  satellite  microwave  receiving 
stations 


airports 
he  I i ports 
enemy  depots 
enemy  command  posts 
enemy  transportation  facilities 
enemy  communication  facilities 
enemy  power  operation  fac i I i t ies/i i nes 
enemy  C3  positions 

t 

Your  consideration  of  weather  should  include  the  following: 


visibi I ity  data 
wind  data 
temperature  data 


humidity  data 
precipitation  data 


OPERATIONAL  HPF-GROUP  WORKSHEET 


HRT6S 


SYSTEM  FUNCTION 


HPF-GROUP  r# 


11  REPRESENTATION  OF  STATUS  OF  FORCES 


5  25 

$  1 
IM  ^ 


.  Indicate  location(s)  of  forces 


2.  Indicate  composition  (number  and  type)  of  forces 


3.  Indicate  availability  of  forces 


Indicate  peculiarities/weaknesses  of  forces 


5.  Indicate  recent  significant  tactical  events  in  which  specific  units 
were  involved 


6.  Indicate  actions  which  forces  are  currently  pursuing 


7.  Indicate  the  enemy  commander(s) '  previous  behavior  in  similar 
situations 


8.  Indicate  combat  effectiveness  of  forces 


9.  Indicate  relative  combat  power  of  enemy  to  friendly  units 


10.  Indicate  relevant  threat  potentials  of  enemy  forces 


11.  Identify  important  missing  information 


12.  Identify  important  information  which  is  internally  inconsistent 
or  probably  inaccurate 


I  z 


in 


See  page  W5-16  for  footnote 


(CONTINUED  ON  NEXT  PAGE) 


SYSTEM 

NAME- 


W6-14 


TEST _ DATE 

TELEPHONE _ 


PAGE 


HRTGS 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  I# 


11  REPRESENTATION  OF  STATUS  OF  FORCES 
- '  (CONTINUED) 


13.  Develop  alternate  sources  of  information 


14.  Prioritize  information  according  to  the  user(s)  needs  and  proba¬ 
bility  of  its  accuracy 


15.  Prioritize  list  of  information  user(s)  for  receipt  of  information 
based  on  their  functions  in  this  specific  operation  and  their 
requ i rements 


n 


MARK  IF  RELEVANT 


HRTGS 


FOOTNOTE  FOR  OPERATIONAL 
HPF-GROUP  WORKSHEET 


11.  REPRESENTATION  OF  STATUS  OF  FORCES 


Your  consideration  of  these  actions  should  include 


direction  of  movement 

speed  of  movement 

apparent  purpose(s)  of  movement 


•  .•--.VvrHr 

"  '■  ‘*-J»  “> 
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HRTGS 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


PROJECTION  OF  BATTLEFIELD  OPERATIONS  < 


1.  Determine  observable  indicators  of  possible  changes  in  the  opera¬ 
tional  situation 


2.  Prioritize  indicators  of  operational  changes 


3.  Assign  intelligence  collection  tasks  to  maximize  receipt  of 
■ndicators  according  to  their  priorities 


4.  Monitor  intelligence  collection  and  reassign  tasks  based  on 
updated  information 


5.  Display  pertinent  information 


6.  Identify  important  missing  information 


7.  Identify  important  information  which  is  internally  inconsistent 
or  probably  inaccurate 


8.  Develop  alternate  sources  of  information 


9.  Determine  which  model (s)  of  expected  enemy  behavior  best  fits 
collected  information 


10.  Assign  confidence  levels  to  the  projection(s) 


11.  Make  recommendations  about  the  effects  of  projected  operations 


12.  Prioritize  information  according  to  user(s)  need  and  probability 
of  accuracy 


(CONTINUED  ON  NEXT  PAGE) 


SYSTEM. 

NAME- 


W5-17 


.TEST _ DATE. 

-TELEPHONE _ 


■  w '•  •I,*’.'  ^  w**  ' 


NEW  HPF  NUMBER 


HRTGS 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


PROJECTION  OF  BATTLEFIELD  OPERATIONS 
(CONTINUED) 


13.  Prioritize  list  of  information  users  for  receipt  of  information 
based  on  their  functions  in  this  specific  operation  and  their 
requ i rements 


MARK  IF  RELEVANT 


OPERATIONAL  HPF-GROUP  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 

- \ 

SPI 

HPF-GROUP 

HPFTj 

*  s  « 

13  PROJECTION  OF  WEATHER  CONDITIONS  <  ^ 

-  ^  2 

Si  i 
oc  * 

±  t 

<  ^ 

1  1 

1.  Collect  relevant  weather  information  for  the  applicable  area(s) 

1 

■ 

2.  Develop  alternative  weather  projections  and  their  indicators 

1 

■ 

3.  Assign  probabilities  to  weather  projections 

1 

■ 

4.  Determine  effects  of  alternate  weather  projections  on  operation(s) 

1 

■ 

5.  Prioritize  indicators  of  weather  projections 

■ 

6.  Assign  weather  indicator  collection  tasks 

■ 

7.  Monitor  weather  indicator  collection  and  reassign  tasks  based  on 
updated  information 

■ 

8.  Update  projection  probabilities 

■ 

9.  Collect,  order  and  display  pertinent  information 

■ 

10.  Identify  important  missing  information 

■ 

11.  Identify  important  information  which  is  internally  inconsistent 
or  probably  inaccurate 

1 

12.  Develop  alternate  sources  of  information 

■ 

13.  Prioritize  information  according  to  user(s)  needs  and  probability 
•  of  accuracy 

■ 

(CONTINUED  ON  NEXT  PAGE! 
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NAME _ TELEPHONE - 

W5-19 


HRTE5 


SYSTEM  FUNCTION 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SPI 


HPF-GROUP 


# 

13 


PROJECTION  OF  WEATHER  CONDITIONS 
(CONTINUED) 
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NAME - - - —TELEPHONE 


W5-20 


J 


MARK  IF  RELEVANT 


OPERATIONAL  HPF-GROUP  WORKSHEET 


HRTGS 


r 


HPPi 


1 . 


2. 


3. 


4. 


SYSTEM  FUNCTION 

SPI 


HPF-GROUP 


# 

14 


SELECT  THE  MOST  APPROPRIATE  FRIENDLY 
UNIT(S)  TO  ENGAGE  IN  OPERATION 


< 

Z 


$ 

Ui 


Determine  the  requirements  the  operation  will  make  on  the  friendly 
un  i  t 


Order  these  requirements  based  on  commander's  priorities 


Identify  friendly  unit(s)  with  the  appropriate  mix  of  attributes 
to  match  the  prioritized  requirements 


Determine  which  friendly  units,  with  the  correct  attributes,  can  be 
removed  from  their  present  operations  without  unacceptable  conse¬ 
quences. 


5.  Determine  , he  transportation  systems  required  to  move  each  friendly 
unit  to  the  operational  area 


6.  Determine  the  availability  of  each  transportation  system  required 
to  move  each  friendly  unit  and  the  time  required  for  it  to  perform 
its  function 


7.  Determine  the  logistics  required  by  each  friendly  unit  to  perform 
its  functions  in  the  operation  in  question 


8.  Determine  the  availability  of  the  supplies  and  delivery  systems  to 
the  operations  area  for  the  required  logistics  of  each  friendly  unit 


9.  Display  all  significant  information  and  order  it  in  some  logical 
and  helpful  manner 


OPERATIONAL  HPF-GROUP  WORKSHEET 


HRTGS 


SYSTEM  FUNCTION 


HPF-GROUP 


i 


SELECTION  AND  ORDERING  OF  APPROPRIATE 
TARGETS 


Locate  potential  targets 


Identify  type  and  number  of  potential  targets 


Determine  threat  potentials  of  targets 


Determine  availability  of  appropriate  friendly  weapon  system 


Determine  the  probability  of  eliminating  target(s) 


Prioritize  targets 


Select  targets  to  attack 


SYSTEM . 
NAME- 


.TELEPHONE. 


W5-22 


MARK  IF  RELEVANT 


OPERATIONAL  HPF-GROUP  WORKSHEET 


HRTG5 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


16  CONTROL  OF  FRIENDLY  FORCES  ON  THE 
BATTLEFIELD 


Z  OC 


I  z 


.  Determine  commanders'  desired  outcome  and  priorities 


2.  Determine  the  tactics  to  be  followed 


3.  Select  the  most  appropriate  friendly  unit(s)  to  engage  in  operation 
(See  Select  the  Most  Appropriate  Friendly  Unit(s)  to  Engage  in 
Operation,  page  W5-21.) 


.  Determine  travel  routes  for  friendly  units 


5. 

Determine  departure  and  projected  arrival  times  for  friendly 

units 

6. 

Prepare  contimgency  plans  and  the  situations  in  which  each  I 
be  implemented  (See  Projection  of  Battlefield  Operations, 
page  W5-17 . ) 

i  s  to 

1 

1 

1 

7. 

Prepare  plans,  orders,  maps  and  other  required  documents 

8. 

Prepare  materials  for  briefing  commanders  and  staffs 

9. 

Monitor  units'  compliance  with  orders  and  their  progress 

10. 

Identify  critical  situations  which  indicate  significant  changes  in 
battlefield  operations 

11. 

Update  plans/orders  as  battlefield  situation  changes 

^  See 

page  W5-24  for  footnote 

I 

I 

I 

I 

I 

I 

I 

I 


FOOTNOTE  FOR  OPERATIONAL 
HPF-GROUP  WORKSHEET 


HRT€S 

(— 

I  The  following  types  of  units  should  be  considered  in  this  selection 


process 

• 

(1 ) 

first  echelon 

(2) 

reserve 

(3) 

i ntel 1 i gence 

(4) 

counter- Intel  1 i gence 

(5) 

ma i ntenance 

(6) 

logistics 

FORCES  ON  THE  BATTLEFIELD 


V _ 

W5-24 
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HRTGS 


OPERATIONAL  HPF-GROUP  WORKSHEET 


HPF^ 


1.  Maintain  information  on  current  status  of  supplies 


2.  Maintain  information  on  maintenance  status  of  equipment  needed 
for  mission 


3.  Recommend  location  of  rear  boundary  bases 


4.  Recommend  main  and  secondary  supply  routes 


5.  Determine  throughput  unit  supply  requirements 


6.  Recommend  movements  which  are  consistent  with  logistics  consider¬ 
ations 


7.  Develop  policies  for  area  damage  control  operations 


MARK  IF  RELEVANT 


HRTES 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


KPF-GROUP  r# 


18  PERSONNEL  PLANNING 


.  Prepare  personnel  estimate  based  on  requirements  of  operation 


2. 

Estimate  casualty  rates  of  friendly  forces 

and  projected  POW’s 

3. 

Prepare  evacuation  contingency  plans 

4. 

Coordinate  personnel  replacement  plans  with 

appropriate 

organizations 

SYSTEM. 

NAME_ 


.TEST _ DATE. 

.TELEPHONE _ 


W5-26 

V"  S’  N.-' 


MARK  IF  RELEVANT 


HRT€S 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


19  RECONNAISSANCE/FIRE  CONTROL 


.  Determine  target  type/number/size/direct  ion/speed/elevation 


2.  Determine  weather  conditions  effecting  weapons  delivery 


3.  Determine  target  coordinates 


4.  Mark  target  locations;  this  may  be  done  by  physical,  chemical, 
radiological  or  electronic  means 


5.  Handoff  target (s)  to  attack  units 


6.  Determine  effects  of  fire  on  target 


7.  Relocate  target (s) 


8.  Adjust  fire  of  attacking  unit(s) 


W5-27 


MARK  IF  RELEVANT 


OPERATIONAL  HPF-GROUP  WORKSHEET 


Identify  key  environmental  features 


2. 

Identify  current  weather  conditions 

3. 

Identify  key  elements  of  threat  force 

4. 

Identify  essential  information  for  evaluating  NBC  contamination 
hazard  outer  1 imits 

H 

5. 

Identify/select  routes 

H 

6. 

Present  information  about  routes  which  could  influence  movement 

7. 

Identify  hazards  to  movement 

8. 

Identify  early  warning  of  enemy  threat 

9. 

Report  map  changes 

W5-28 


MARK  IF  RELEVANT 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


ESTABLISHMENT  AND  MAINTENANCE 
OF  COMMUNICATIONS 


.  Assemble  communications  deviceCs) 


2.  Assemble/erect /orient  antenna 


3.  Establish  communications  net 


.  Enter  communications  net 


5.  Transmit  messages 


6.  Receive  messages 


W5-29 


MARK  IF  RELEVANT 


OPERATIONAL  HPF-GROUP  WORKSHEET 


W5-30 


MARK  IF  RELEVANT 


HRT€S 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  W 


23  INFORMATION  ROUTING 


.  Identify  appropriate  recipients  of  information 


2. 

Prioritize  recipients  for  the  delivery  of 

informat  ion 

3. 

Prioritize  pieces  of  information  for  delivery 

4. 

Assign  security  classification  and  method 

for  maintaining  that 

classi fi cat  ion 

5. 

Determine  call  signals/frequencies 

MARK  IF  RELEVANT 


W5-32 


HRT6S 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP 


25  VEHICLE  MANEUVERING— HELICOPTERS 


HPF’s 


.  Perform  takeoff  to  hover 


2. 

Perform 

instrument  takeoff 

3. 

Perform 

hover  checks 

.  Perform  hovering  turns 


5.  Perform  hovering  flight 


6.  Perform  normal  takeoff 


7.  Perform  maximum  performance  takeoff 


8.  Perform  straight  and  level  flight 


9.  Perform  cl imbs  and  descents 


10.  Perform  turns 


1 


11.  Perform  instrument  turns 


12.  Perform  aceleration/deceleration 


13.  Perform  traffic  pattern  flight 


14.  Perform  high  speed  flight 


15.  Perform  hovering  autorotation 


16.  Perform  standard  autorotation 


17.  Perform  standard  autorotation  with  turn 


(CONTINUED  ON  NEKT  PAGE) 
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HRT€S 


OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  [# 


VEHICLE  MANEUVERING— HELICOPTERS 
(CONTINUED) 


Perform  holding  procedures 


Perform  unusual  attitude  recovery 


Perform  before- 1  and i ng  check 


Perform  shailow  approach  to  a  running  landing 


Perform  landing  from  hover 


Perform  normal  landing  approach 


Perform  shallow  landing  approach 


Perform  steep  landing  approach 


Perform  instrument  approach 


Perform  GCA  approach 


Perform  IFR  helicopter  recovery  procedure 


Perform  tactical  instrument  approach 


Perform  go  around 


SYSTEM. 

NAME- 


.  TELEPHONE. 


W5-34 
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OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  _ _ TEST _ DATE _ PAGE 
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MARK  IF  RELEVANT 


HRT€S 


OPERATIONAL  HPF-GROUP  WORKSHEET 


Select  appropriate  maps  and/or  navigation  aids 


2. 

Identify  present  location 

3. 

Identify  destination 

1 

4,  Select  travel  route  1 

5. 

Estimate  time  of  arrival  and 

fuel  requirements 

6. 

Travel  designated  route 

7. 

Identify  position  or  route  at 

1 

specified  times/locations 

SYSTEM. 

NAME- 


.TEST _ 

.TELEPHONE 


MARK  IF  RELEVANT 


OPERATIONAL  HPF-GROUP  WORKSHEET 


1.  Load  and  position  cargo/passengers  in/on  vehicle 

2.  Secure  cargo/passengers 

3.  Unload  vehicle 

4.  Fuel  vehicle 

5.  Load  ammunition 


W5-37 


MARK  IF  RELEVANT 


1^  OPERATIONAL  HPF-GROUP  WORKSHEET 


1.  Position  recovery  vehicle(s) 

2.  Prepare  recovery  vehicle(s) 

3.  Prepare  system  to  be  recovered 


4.  Attach  cables  between  system  to  be  recovered  and  recovery  vehicles 

5.  Recon no  iter  recovery  area 

6.  Tow/ I i ft /push  system  to  be  recovered 

7.  Disassemble/stow  recovery  equipment 


MARK  IF  RELEVANT 
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OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


KPF-GROUP  r# 


SELF-RECOVERY 


.  Prepare  system  for  self-recovery 


2.  Reconnoiter  for  appropriate  anchor  points  and  recovery  path 


3.  Position  anchors 


.  Attach  cables  to  anchors/winches 


5.  Pull  system  to  safe  area 


6.  Disassemble/stow  self-recovery  components 


MARK  IF  RELEVANT 
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OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  {# 


31  ESCAPE  FROM  SYSTEM  HARDWARE 


1.  Destroy  or  alter  critical  components  of  communication  and  other 
sensitive  equ ipment/documents 


2.  Take  personal  weapon,  ammunition,  and  survival  equipment 


3.  Position  system  hardware  for  escape,  if  possible  under  the 
conditions  imposed 


4.  Open  escape  path  out  of  system  hardware 


5.  Escape  from  system  hardware 


■■ 

R 


SYSTEM. 

NAME- 


.TELEPHONE 


MARK  IF  RELEVANT 
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OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  [# 


32  SYSTEM  PROTECTION  FROM  THREAT 


1.  Identify  threat  to  system;  e.g.,  onboard  fire,  flooding, 
imminent  crash,  NBC,  enemy  attack 


2.  Activate  hardware  protective  device(s) 


3,  Put  on  protective  gear/clothing 


.  Secure  materia  I /cargo  for  protection  against  threat 


5.  Assume  protective  position  for  crew/passengers 


6.  Maneuver  to  protect  from  threat 


Deactivate  hardware  protective  device(s) 


MARK  IF  RELEVANT 
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OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


PREVENTION  OF  DETECT  I ON/LOCAT I  ON 
OF  SYSTEM 


1.  Detect  threat  warning(s)  which  indicate  either  search  or  attack 
modes 


2.  Identify  the  nature  of  the  threat(s)  from  which  detected  threat 
warnings  emanate 


3.  Take  appropriate  countermeasures  to  reduce  the  probability  of 
identification  of  location^ 


.  Camouflage  system 


"See  page  W5-43  for  footnotes 


SYSTEM. 

NAME- 


.TELEPHONE. 


W5-42 


MARK  IF  RELEVANT 


FOOTNOTE  FOR  OPERATIONAL 
HPF-GROUP  WORKSHEET 
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^^53^PREVENT10N  OF  DETECTION/LOCATION  OF  SYSTEM 


Vhese  countermeasures  include: 

jamming 
smoke 
f I  ares 
chaff 

powered  decoys 
signature  alteration 

electronic  attack  of  threat-sensing  equipment 


2 

System  camouflage  includes: 

phys  ica 1 
infrared 

radar  signature  reduction 
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OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  f# 


34  ENGINEERING— OBSTACLE  REMOVAL/ 

BREACHMENT 


.  Acquire  obstacle  to  be  dealt  with 


!.  Prepare  system  hardware  for  obstacle  remova I /breach  1 ng.  The  nature 
of  this  preparation  is  entirely  dependent  upon  the  sort  of  system 
under  consideration.  It  may  involve  preparation  for  bulldozing, 
gun  firing,  demolition,  etc. 


).  Decide  on  placement  of  fire,  charge,  or  pressure  in  relation  to 
obstac  I  e 


.  Remove/breach  obstacle 


5,  Remove/displace  remains  of  obstacle 


MARK  IF  RELEVANT 
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OPERATIONAL  HPF-GROUP  WORKSHEET 


SYSTEM  FUNCTION 


HPF-GROUP  [# 


35  ENGINEERING-BRIDGING 


Prepare  bridge  site 


Excavate  foundations 


Construct  bridge  abutments 


Construct  bridge  span 


Construct/assemble  bridge 


Prepare  bridge  for  launching 


Position  bridge  transporter  for  launching 


Launch/drive  bridge  into  wafer 


Connect  bridge 


Recover  bridge 


Disassemble  bridge 


MARK  IF  RELEVANT 
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GUIDELINES  FOR  DEVELOPING 

MAINTENANCE  HUMAN  PERFORMANCE  FUNCTIONS 


System  Performance  Issues  (SPI's)  are  major  activities  which  must  be 

• 

performed  by  a  system.  Human  Performance  Functions  (HPF*s)  are  those 
human  activities  which  are  required  to  carry  out  each  SPI  of  a  system. 
There  are  two  general  types  of  HPF’s:  those  required  for  the  actual 
performance  of  an  SPI — called  Operational  HPF's,  and  those  required  for 
the  continued  performance  of  an  SPI — called  Maintenance  HPF*s.  You  are 
being  asked  to  aid  in  developing  Maintenance  HPF's  for  specific  SPI's. 

Maintenance  HPF's  for  a  given  SPI  may  be  scheduled  or  unscheduled. 
Scheduled  and  unscheduled  Maintenance  HPF's  may  be  performed  by  system 
operators  or  by  designated  maintenance  personnel. 

A  Maintenance  HPF  should  start  with  an  action  verb  and  give  a  specific 
object.  For  example,  "Purge  Turret  Hydraulic  Lines"  or  "Clean  Engine 
Intake  Filters."  The  following  list  of  action  verbs  should  prove  helpfu 
to  you  in  writing  the  HPF's. 


Inspect  _ 

Lubricate  _ 
Fi I  I /Drain 

Purge  _ 

Paint  _ 

Clean 


Change/Replace  _ 

T  roub I eshoot/D i agnose 

Remove  _ 

Disassemble/Assemble 

Install  _ 

Adjust/Align  _ 


Each  of  the  "Maintenance  Worksheet"  which  you  have  been  given  contains  the 
name  of  the  system,  the  class  In  which  that  system  falls,  the  system  function, 
and  the  SPI  for  which  you  are  to  provide  Maintenance  HPF's.  Read  the 


GUIDELINES  FOR  DEVELOPING 

MAINTENANCE  HUMAN  PERFORMANCE  FUNCTIONS 

(Continued) 


HRTeS 


following  instructions  and  comolete  the  Worksheets.  Use  your  expertise 
about  the  maintenance  of  this  system  class  or  specific  system,  and  any 
other  relevant  documentation  to  develop  the  HPF's. 

(1)  For  each  5PI,  record  on  the  "Maintenance  Worksheet"  all  those 
HPF's  which  meet  either  of  the  following: 

(a)  HPF  is  necessitated  by  a  h i qh  probability  of  breakdowns 
in  that  part  of  the  system  which  is  involved  in  the  per¬ 
formance  of  the  SPI.  Consider  the  probable  conditions 

in  which  this  system  will  be  actually  operated,  including 
any  specific  conditions  contained  in  the  SPI  statement. 

(b)  If  the  HPF  is  performed  poorly,  it  will  result  in  a 
breakdown  or  poor  system  performance  of  the  SPI. 

(2)  For  each  HPF,  indicate  on  the  Worksheet: 

(a)  Who  will  perform  it  (i.e.,  maintenance  personnel,  system 
operators,  or  both.) 

(b)  What  type  of  Maintenance  HPF  it  is  (i.e.,  scheduled, 
unscheduled,  or  both.) 

(3)  Return  the  completed  forms  to  the  sender. 
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MAINTENANCE  WORKSHEET 


SYSTEM _ TEST _ DATE _ PAGE 

NAME _ TELEPHONE _ 
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TEST  CONDITION  WORKSHEET 


SYSTEM. 

NAME- 


.TEST _ DATE. 

.TELEPHONE _ 
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FINAL  CONDITION  SET  WORKSHEET 
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GUIDELINES  FOR  DEVELOPING 
PERFORMANCE  CRITERIA 


r 


You  have  received  a  set  of  "Criterion  Worksheets."  Each  one  corresponds 
to  a  specific  Human  Performance  Function  (HPF)  which  will  be  measured  in 
the  Operational  Test.  In  addition,  you  have  received  "Final  Condition 
Set  Worksheets"  for  the  appropriate  HPF's.  To  determine  if  an  HPF  trial 
has  been  performed  successfully,  it  is  necessary  to  define  what  a  success¬ 
ful  p  -formance  means,  or  to  define  what  we  call  the  performance 
criterion  of  the  HPF.  Usually,  this  can  be  done  by  determining  the  maxi¬ 
mum  acceptable  time  to  perform  the  HPF  and/or  by  specifying  a  minimum 
level  of  accuracy.  HRTES  distinguishes  between  three  types  of  criteria: 
(a)  time  criterion,  (b)  accuracy  criterion,  and  (c)  combined  time  and 
accuracy  criterion.  It  is  expected  that  the  third  type  will  be  used  most 
frequent  I y . 

As  an  example:  "The  time  for  performing  a  specific  HPF  should  not  exceed 
30  seconds  is  a  time  criterion."  "Number  of  errors  while  performing  this 
HPF  should  not  exceed  10  errors  is  an  accuracy  criterion."  "The  HPF 
should  be  done  in  less  than  10  seconds  with  no  more  than  5  errors  is  a 
combined  time  and  accuracy  criterion." 

Development  of  a  time  criterion  for  an  HPF  is  quite  straightforward.  If 
the  MENS,  ROC,  or  LOA  provides  you  with  an  appropriate  SPI  time  criterion 
your  task  will  then  be  to  a  I  locate  that  time  to  each  of  the  HPF’s  of 
the  SPI.  Otherwise,  each  HPF  time  criterion  will  have  to  be  developed 
according  to  your  own  expertise. 

Development  of  a  criterion  which  includes  accuracy  is  more  complicated. 

For  each  HPF,  you  will  I  have  to  determine  the  various  significant  errors 
which  can  occur,  and  decide  whether  you  want  to  distinguish  between 
different  kinds  of  errors  in  your  criterion. 


GUIDELINES  FOR  DEVELOPING 
PERFORMANCE  CRITERIA  (Continued) 
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To  develop  an  appropriate  performance  criterion  for  each  HPF,  you  have 
to  consider  the  condition  set  under  which  the  HPF  is  going  to  be  tested. 

If  an  HPF  has  more  thro  one  condition  set,  you  may  have  to  determine  a 
different  criterion  for  each  condition  set  of  the  HPF. 

Each  of  the  "Criterion  Worksheets"  is  attached  to  appropriate  "Final 
Condition  Set  Worksheets."  Both  Worksheets  contain  the  name  of  the 
system,  the  System  Function,  the  SPI,  and  the  HPF. 

On  the  "Criterion  Worksheet"  the  numbers  corresponding  to  condition  sets 
are  recorded  in  the  top  row. 

The  following  instructions  will  aid  you  in  developing  the  performance 
criterion  for  each  HPF  under  each  of  the  condition  sets: 

(1)  Decide  what  type  of  criterion  is  most  appropriate,  i.e.,  time, 
accuracy,  or  combined  time  and  accuracy. 

(2)  If  your  criterion  includes  accuracy,  you  have  to  specify  all 

the  significant  errors  in  the  appropriate  place  on  the  Worksheet. 

ERROR  CLASSIFICATION  FOR  ACCURACY  CRITERION  DEVELOPMENT 

If  you  already  know  which  errors  are  important  and  should  be  used  to  define 
the  accuracy  criterion  for  each  HPF,  the  following  is  unnecessary.  However, 
if  you  find  the  identification  of  the  appropriate  errors  difficult,  applying 
the  following  classification  scheme  may  prove  helpful. 


HRT€S 


r 


np£  Of  m  (tmk) _ typi  of  ewor _ 

Ptneptual  uid  Aiieclitad  1.  Tttk  or  Uik  s*oiMnt  oalttad. 

Htfitti  PreeusM 

'  2.  No1t»  (kxtranMut  abjtcts/ltforMtlOP)  or 
nothin}  Idontifird  u  tignol  (okj(ct/1n- 
formtlon  noMod  for  Hff  porforMnci). 

1.  S<9n*1  idofltiflod  tl  noito. 

*.  S<9fii1  rtcognizid  tt  iuch.  Out  no  Idtnt- 
Iflcition  or  clutiflcktlon  aodo. 


$.  S<}nt1  ariiclutlfiod  or  oltundorttoed. 

mtelkMlficatlon  CM  bo  porforaM  In  i  nuoMr 
of  C4t040rlts.  Coch  c«t040ry  producH  «  diff* 
front  postibit  orror. 


(.  Inumtt  aunlnp  ottrlbutad  to  ilgntU  ahlch 
tavf  boon  corroctly  cUtsIflod/undonteod. 
Thfft  oro  orrors  of  thinking  tnd  ooclllon 
■iking  btitd  on  porciptuol  Input. 


EXMfLE 

1.1  Torgtt  not  dotoctod. 

1.2  Ktstogt/kiy  arord  not  hnrd. 

2.1  Rock  Idtntiflid  »  Urgtt. 

2.2  SUtIc  Idontlflod  is  otstigo. 

3.1  Tkrgot  Idontlflod  ot  rock. 

3.2  Hoitogo  Idontlflod  u  itotic. 

4.1  Signol  rocognitod  u  non-nolio. 
but  cannot  bo  dociphorod. 

4.2  Hcstigo  can  bo  rood,  but  not 
ondontood  (rathor  thon  bIi* 
undorttood). 

5.1  Frlandly  elaatlflod  at  onoqr. 

5.2  Enaqr  clatalflad  tt  frtondly. 

5.3  High  rlik  elaatlflod  at  lou  risk. 

5.4  Nodliai  tank  elualflod  a  tank 
doftroyor. 

1.5  m  elaatlflod  ai  T(2. 

5.5  flatpon  Bravo  elaatlflod  tt 
Platoon  Alpha. 

5.7  Moving  targot  cltitlflcd  u 
itatlonary  targot. 

5.5  Ono  ivy  aord  of  otstago  undor* 
itood  01  otftor  vorO  idilch  altart 
oottago  aaonlng. 

5.1  Incorrect  target  prlorltlatlon. 

6.2  Enwy  In  attack  thought  to  bo  In 
dofonto. 

6.3  Error  In  location  of  potmtltl 
onaty  breakthrough  point. 


HRT65 


nPt  OF  HFf  (TASK) 


nn  OF  Ewo« 


NinipuUtenr  (netor) 


1.  Ttik  ar  tilt  iifMnt  oalttad. 


2.  IiKorriet  control  or  objoct  atnl pull tod. 


3.  Control  or  object  abnlpulitid  Incorroctly. 


CoOTunleitJon  Outout 


1.  Cntiro  Bbiitoo  or  tc^iont  of  msiiob  wlttbd. 


2.  Incorroet  or  Inoporoortito  Inforoitlon 
comnlcitod. 


3.  Sirblod  (not  iindorstindiblo)  mtbfiil 
eoMunleitod. 


4.  Htitiii  font  to  iMPoroprlito  roelplont. 


S.  Hosiigo  font  In  InipproprIiU  formt. 


1.1  yohicli  briko  not  ippitod. 

1.2  CovliMit  not  tlgntmod  following 
ilfgnoont. 

2.1  Incorroct  Inpot  toy  ictivotod. 

2.2  Wrong  twialtlon  loidod. 

3.1  OltUKi  'roa  torgot  to  udkinlt* 

<on  lopoct  ooro  thin  X. 

3.2  Oiiunei  tr»  Oolirtd  yonitli 
poOi  (In  nomuyor)  to  ictfiol 
yibicio  potli  oon  thin  X  it  ipoc* 
Iflid  ooiturannt  points. 

3.3  Moon  M-rpr  of  control  oinlpolitlon, 
lloctrleolly  OMiurod.  grootor 
thin  1  during  oonouvor. 

3.4  Control!  ictivotod  out  of  iMuonco. 


1.1  Nckiigo  not  ipokon  or  lont. 

1.2  Idnntiflid  koy  oord  not  ipokon  or 


2.1  Ineomct  locitlon  twit. 

2.2  Shopping  lilt  lont. 


3.1  Entin  aiiiigt  girblod. 

3.2  tdwitlflod  koy  vord  girtlod. 


4.1  Mcisigi  font  to  orong  friwidly  unit. 

4.2  Nnsigo  lint  to  wiaiy  unit. 


5.1  MtsiiQf  or4ar  wrong. 

5.2  Htssigt  not  codtd  proptrly. 

5.3  Inoppropriato  syvibolt  ustd. 


SYSTEM. 


NAME. 


.TELEPHONE. 
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You  must  be  able  to  define  if  an  error  has  occurred.  The 
definition  of  some  errors  require  no  physical  measurements  for 
their  identification;  for  example,  loading  the  wrong  type  of 
ammunition.  The  definition  of  other  errors  is  more  arbitrary 
and  requires  physical  measurement.  In  this  case,  you  must 
specify  the  cutoff  point  which  defines  the  error's  occurrence. 
For  example,  in  the  HPF,  "Aim  Weapon,"  the  distance  between 
the  hit  and  the  target  would  be  considered  an  error  when  it 
surpassed  a  specified  size.  Otherwise,  it  would  not  be  defined 
as  an  error  (i.e.,  hit  outside  one  meter  from  the  target  would 
be  an  error) . 

(3)  If  you  selected  a  time,  or  time-accuracy  criterion,  record  the 
maximum  acceptable  criterion  in  the  appropriate  space  on  the 
worksheet. 

(4)  Now  you  are  ready  to  write  the  actual  performance  criterion. 

You  can  write  only  one  of  the  following  criteria  in  each  column 
of  the  Worksheets: 

Time  Criterion. 

Accuracy  Criterion. 

Time-Accuracy  Criterion. 

(a)  Time  Criterion:  Copy  the  maximum  acceptable  criterion 
time  into  the  "Performance  Criterion  Box." 

(b)  Accuracy  Criterion:  Specify  the  maximum  number  or  percen¬ 
tage  of  errors  allowed  in  the  performance  of  one  trial  of 
the  HPF  in  each  condition  set.  You  may  distinguish  between 
different  errors  or  consider  them  all  together.  Record 
this  in  the  "Performance  Criterion  Box." 


SYSTEM. 

NAME_ 


.TELEPHONE. 
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GUIDELINES  FOR  DEVELOPING 
PERFORMANCE  CRITERIA  [Continued) 


(c)  Time-Accuracy  Criterion:  Do  (a)  and  (b)  above,  and 
record  combination  in  the  "Performance  Criterion  Box." 
See  Sample  "Criterion  Worksheet.") 

(5)  Do  not  fill  in  the  bottom  two  rows  of  the  Worksheets. 

(6)  Return  ail  materials  to  sender. 
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CRITERION  WORKSHEET 


^  SYSTEM  FUNCTION 

SPI 

EToper.  hpf 

□  MAINT. 

l?^fT /^(pUl^iT/DiJ  lO  FULL  SUtJu^Hr 

XBnZTAP^O  IDQjrif^  TAAjiSrS 

1  1*  /  1  *3 

\  CONDITION  sn  I  '  1  CONDITION  SCT 

ERRORS 

^7^aasrujif7HX4rD^rs:-rioi<J 
ai.  SJeMt^  &2ga^ 
^■7ni4£r  ivp’S. 

f)mi^/Uoi>eL  JSAAOA^ 

OAM£Asa>iJt>fr,(»J^  Pj 

MAXIMUM 
ACCEPTAIIE  HME 

0.0  aecouos 

Sc 

FERK3RMANCE 

CRITERION 

IP: 

Auy  j  am  Mcme:  oPACo\/e 
G*AoiiS  ^  AMDS,  OA. 

/P  TKiAL.  ■35^5 

20  aecoi^J>s> 

ITSAI.  /p: 

aZfioAS  1  09,  2  OCauP.,., 
J2Sr  SAAoAS  «5^  AuD 

S’  all  e>e 

IPTAipL,  TAtt^S  /yfOAS 

"T^aJ  jo  oecoA^CS 

STATISTIC 

STATISTIC  CRnERION 

< 
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CRITERION  WORKSHEET 
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GUIDELINES  FOR  DEVELOPING 
STATISTICS  AND  STATISTIC  CRITERION 


You  have  received  "Criterion  Worksheets"  and  "Final  Condition  Set  Work¬ 
sheets"  for  each  HPF.  In  each,  sets  of  conditions  under  which  the  HPF 
will  be  tested  are  specified.  For  each  HPF  under  each  condition  set, 
the  definition  of  one  successful  trial  is  already  listed  in  the  "Perfor¬ 
mance  Criterion"  row. 


To  evaluate  the  performance  of  an  HPF,  more  than  one  trial  should  be 
performed  and  all  the  measure  outcomes  from  such  trials  should  be 
considered  for  evaluation.  To  do  so,  the  outcomes  have  to  be  aggregated 
to  produce  what  in  HRTES  is  call  a  statistic. 

Mainly,  there  are  two  ways  for  aggregating  the  outcomes:  (a)  by  taking 
the  average  of  all  the  measure  outcomes  for  the  specific  HPF;  and  (b)  by 
calculating  the  percentage  of  successful  performances  of  the  HPF.  A 
successful  trial  is  defined  by  the  "performance  criterion." 


These  are  two  basic  statistics:  the  average,  and  the  percentage  can  be 
expressed  by  the  following  formulas: 


AVERAGE 


Sum  of  Total  Outcomes 
Number  of  Trials 


Number  of  Successful  Trials 

PERCENTAGE  =  100  x  — r - ^ - 

Number  of  Tria  s 


To  evaluate  the  performance  of  an  HPF,  it  is  necessary  to  have  a  criterion 
for  each  statistic  that  is  employed.  HRTES  refers  to  this  criterion  as 
a  statistic  criterion.  For  example,  a  statistic  criterion  for  a  percentage 
statistic  might  be:  "A  minimum  success  percentage  of  80$. "  A  statistic 
criterion  for  an  average  statistic  might  be:  "At  most  an  average  time  o-^ 

30  seconds." 
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GUIDELINES  FOR  DEVELOPING 

STATISTICS  AND  STATISTIC  CRITERION  (Continued) 


The  procedure  suggested  is  to  first  determine  the  appropriate  statistic 
for  each  measure,  and  from  it  to  define  the  statistic  criterion.  In 
most  cases,  percentage  is  preferable  since  it  enables  us  to  combine 
several  measure  dimensions  into  one.  The  average  statistic  may  be  used 
when  an  HPF  is  measured  by  only  one  kind  of  data,  i.e.,  only  fine  or  only 
one  type  of  error. 

Another  determination  that  should  be  made  at  this  point  is  whether  the 
aggregation  procedure,  percentage  or  average,  should  be  made  for  an  HPF 
under  each  separate  condition  set,  or  combined  across  all  condition  sets 
for  the  HPF  in  question.  (This,  of  course,  is  not  a  problem  when  an  HPF 
is  tested  under  only  one  condition  set.)  There  is  a  trade-off  between 
the  number  of  trials  for  the  HPF  and  the  information  to  be  gained.  If 
one  wants  to  determine  the  effect  of  different  condition  sets  on  HPF 
performance,  enough  trials  under  each  of  the  condition  sets  must  be 
performed,  and  the  statistics  must  be  calculated  and  treated  separate  I y 
under  each  condition  set.  However,  if  one  wants  to  evaluate  the  HPF  in 
general,  and  is  interested  in  including  conditions  only  to  insure 
representation  and  doesn’t  need  to  make  reliable  statements  of  the  effects 
of  each  condition  set  on  the  HPF,  then  the  aggregation  should  be  made 
across  condition  sets,  and  thus  will  require  fewer  trials  for  the  HPF. 

For  each  HPF : 

(1)  Determine  the  appropriate  statistic  (percentage  or  average)  for 
each  HPF,  and  record  it  in  the  "Statistic  Row"  of  the  Worksheet. 
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GUIDELINES  FOR  DEVELOPING 

STATISTICS  AND  STATISTIC  CRITERION  (Continued) 


(2)  Determine  whether  the  statistics  will  be  aggregated  across  all 
condition  sets  of  a  given  HPF  or  for  each  condition  set 
separately.  This  decision  will  affect  the  following  procedure. 

(3)  Determine  the  statistic  criterion  for  each  statistic  developed 
in  (1),  and  record  the  information  in  the  appropriate  place 

on  the  "Statistic  Criterion"  row  of  the  Worksheet, 

If  you  have  decided  on  separate  aggregation  for  each  condition 
set  then  you  have  to  define  a  separate  statistic  criterion  for 
each,  and  record  it  in  the  appropriate  space  in  each  "Condition 
Set"  column.  If  you  decided  to  aggregate  across  a  I  I  condition 
sets  for  an  HPF,  record  the  statistic  criterion  in  one  column, 
and  write  "Across  Conditions"  in  the  other (s).  (See  "Sample 
Worksheet.") 

(a)  When  the  statistic  is  a  percentage,  the  criterion  associated 
with  it  is  the  minimum  percentage  of  HPF  trials  which  are 
to  be  performed  successfully  to  meet  operational  require¬ 
ments.  To  determine  this  criterion  you  have  to  consider 
the  definition  of  a  successful  performance  of  a  trial  for 
each  condition  set  very  carefully.  There  is  a  tradeoff 
between  the  performance  criterion  and  the  statistic  criterion. 
If  the  performance  criterion  is  extreme,  you  might  consider 
a  smaller  percentage  of  success  as  a  statistic  criterion 
and  vise  versa. 
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STATISTICS  AND  STATISTIC  CRITERION  (Continued) 


(b)  When  the  statistic  is  an  average,  the  defintion  of  statis¬ 
tic  criterion  is  quite  straightforward.  If  the  statistic 
is  aggregated  for  one  condition  set,  the  criterion,  i n 
most  cases,  is  the  same  as  the  performance  crilerion.  If 
you  decided  to  aggregate  over  all  condition  sets,  it  is 
suggested  that  the  statistic  criterion  will  be  the  average 
of  the  performance  criterion  for  the  different  condition 
sets. 


(4)  Return  the  completed  Worksheets  to  the  test  planner. 
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6.  HUMAN  PERFORMANCE  MEASUREMENT 


CONTENTS 

1.  Performance  Data  Collection  Worksheet 

2.  Beginning  and  End  Point  Worksheet 

3.  Planning  Data  Collection  Worksheet  (8  pages) 

4.  Guidelines  for  the  OT  Training  Data  Collection  Worksheet 

5.  OT  Training  Data  Collection  Worksheet 

6.  Guidelines  for  Collecting  Data  for  Diagnosis  During  OT  (2  pages) 

7.  HPF  Difficulty  Worksheet  for  OT  Observers 

8.  HPF  Difficulty  Worksheet  for  OT  Participants 

9.  Performance  Difficulty  Questionnaire  for  OT  Observers 

10.  Performance  Difficulty  Questionnaire  for  OT  Participants 

11.  Critical  Incident  Report 

12.  Opinion  Summary  Data  Worksheet 

13.  Statistic  Worksheet 
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PERFORMANCE  DATA  COLLECTION  WORKSHEET 


SYSTEM  FUNCTION 


□  OPER 

□  MAINT 


CONDITION  SET(S) 


ONE  PERFORMANCE  UNIT 

NUMBER  OF  TRIALS  PER  PERFORMANCE  UNIT  RECOMMENDED 
NUMBER  OF  PERFORMANCE  UNITS  RECOMMENDED  | 
PERFORMANCE  UNIT  DESIGNATION 


TRIAL  # 


DATA  TO  BE  TAKEN* 


OUTCOME 


SPECIFY  IF 

nzH  UNSUCCESSFUL 
AND  EXPLAIN 
<0<  REASON 


•If  time  is  to  be  measured,  specify  time  units 


SYSTEM 


TELEPHONE 
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BEGINNING  AND  END  POINT  WORKSHEET 


Consider  the  Performance  Criterion  of  the  HPF's  and  ask: 


(1)  Are  measures  best  taken  by  an: 

Observer  Instrumentation 

□  □ 


Combination  of  Both 


If  you  selected  Observer,  or  Combination  of  Both,  continue 
with  2. 

(2)  Is  there  space  for  an  observer  without  significantly  disturbing 
the  performance  you  want  to  measure? 


YES 

NO 

□ 

□ 

If  the  answer  to  this  question  is  no,  you  will  probably  have  to 
collect  your  data  with  instrumentation;  turn  to  S'  =p  18. 

(3)  What  sort  of  background  (previous  training,  experience,  MOS, 
etc.)  will  be  required  of  the  observer(s)? 
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WORKSHEET  FOR  PLANNING 
DATA  COLLECTION  (Continued) 


(4)  How  many  observers,  with  this  background,  will  be  required  to 
measure  the  performance? 


(5)  What  is  the  source  of  observers  with  appropriate  backgrounds? 


(6)  How  long,  in  advance  of  the  OT,  must  you  begin  to  arrange  for 
the  avai lability  of  these  observers? 


(7)  What  date  will  this  be? 


(8)  What  sort  of  training  will  be  required  for  the  observers? 


(9)  Who  will  provide  this  training?  The  answer  to  this  question 
may  be  obvious  if  there  are  OT  personnel  who  have  been  dedi¬ 
cated  to  observation  training.  If  the  answer  is  not  obvious, 
you  should  consider  repeating  Steps  2-8  substituting  the  words 
"observer  trainer"  for  the  word  "observer." 


(10)  What  sort  of  materials,  equipment,  and  information  will  be 
required  for  the  observer  training? 


(11)  Who  will  supply  observer  training  material? 


(12)  How  much  lead  time  is  required  for  the  development  of  observer 
training  material? 
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DATA  COLLECTION  (Continued) 


Date  development  must  begin  - 


Date  all  material  must  be  completed  - 


(13)  Where  will  observer  training  take  place? 


I 


ty 


'  0 

i 

r  • ; 


(14)  How  long  will  observer  training  take? 


(15)  What  kind  of  Data  Collection  Forms  (Check' ists,  etc.)  will  be 
required? 


(16)  Who  will  produce  these  forms? 
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WORKSHEET  FOR  PLANNING 
DATA  COLLECTION  (Continued) 


(17)  By  what  date  must  these  forms  be  completed? 


If  you  selected  Instrumentation  or  Combination  of  Both  continue 
with  Step  18. 

(18)  What  kind(s)  of  instrumentation  is  required  to  obtain  the 
necessary  data? 


(19)  Is  there  space  for  the  instrumentation  without  significantly 
disturbing  the  performance  you  want  to  measure? 


YES 

NO 

□ 

□ 

If  the  answer  to  this  question  is  no,  and  there  is  also 
Inadequate  space  for  an  observer,  you  will  have  to  either: 

(1)  Switch  to  another  variety  of  instrumentation, 
or 

(2)  Collect  this  Information  through  debriefing. 
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DATA  COLLECTION  (Continued) 


(20)  Is  there  adequate  power  for  the  device? 


If  the  answer  to  this  question  is  no,  you  will  have  to  either: 

(1)  Switch  to  another  variety  of  instrumentation, 
or 

(2)  Provide  another  source  of  power, 
or 

(3)  Use  an  observer  to  collect  data, 
or 

(4)  Collect  this  information  through  debriefing. 

(21)  Is  the  instrumentation  available  to  you?  To  answer  this 

question  adequately,  you  will  first  have  to  find  out: 

(1)  If  it  already  exists 


(2)  Where  it  can  be  obtained 
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DATA  COLLECTION  (Continued) 


(3) 


The  lead  time  for  obtaining  it 


(4)  How  long  It  takes  to  Install  it  in  your  System 


If  the  answer  Is  no,  you  will  have  to 

(1)  Switch  to  another  variety  of  instrumentation, 
or 

(2)  Use  an  observer  to  co) lect  data, 
or 

(3)  Collect  this  information  through  debriefing. 

(22)  Are  Installation  and  maintenance  of  the  instrumentation  going 
to  require  technicians  dedicated  to  this  project? 


YES 

NO 

□ 

□ 

The  answer  to  this  question  may  be  obvious  if  there  are  OT 
personnel  who  have  already  been  dedicated  to  this  function. 
If  the  answer  is  not  obvious,  you  should  consider  repeating 
the  most  applicable  of  Steps  2-8  substituting  the  word 
technician  for  observer. 
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If  you  selected  Combination  of  Both,  all  questions  from  2-22 
apply  to  you.  In  addition  answer: 

(23)  Is  there  enough  space,  for  both  the  observer  and  the  instru¬ 
mentation,  without  significantly  disturbing  the  performance 
you  want  to  measura? 

YES  NO 

□  □ 


If  the  answer  to  this  question  is  no,  you  will  have  to: 

(1)  Switch  to  another  form  of  Instrumentation, 
or 

(2)  Remove  either  the  observer  or  the  instrumentation, 
or 

(3)  Collect  this  information  through  debriefing. 


I  GUIDELINES  FOR  COMPLETING 

bif  I  OT  TRAINING  DATA  COLLECTION  WORKSHEET 

f - N 


You  are  asked  to  record  the  amount  of  time  required  for  training. 

This  package  includes  the  Guidelines  you  are  reading;  a  list  of  Human 
Performance  Functions  (these  are  the  tasks  which  you  trained);  and  the 
"OT  Training  Data  Collection  Worksheet."  Immediately  following  OT  Training, 
fill  out  the  "OT  Training  Data  Collection  Worksheet."  The  following 
instructions  will  aid  you  in  completing  the  Worksheet: 

(1)  List  the  tasks  (HPF’s)  you  trained  In  the  left-hand  column  of  the 
Worksheet.  Examine  the  enclosed  list  of  tasks  (HPF's  and  select 
those  you  have  trained. 

(2)  Potential  training/practice  methods  are  listed  on  the  matrix 
edge.  If  you  used  a  method  not  listed,  add  it. 

(3)  Each  cell  should  be  filled  in  with  the  number  of  hours  or 
fraction  of  hours  used  to  train  each  task  according  to  each 
training  method. 

(4)  Add  across  each  row  to  determine  the  "sum"  of  total  training 
and  practice  time  for  a  given  task. 

(5)  Return  the  Worksheet  to  the  sender  to  be  included  with  other 
test  documentation. 
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The  "Detailed  Test  Plan"  for  this  OT  divides  the  performance  of  the 
system  to  be  tested  Into  System  Functions,  it  then  divides  each  System 
Function  into  System  Performance  Issues  (SPI’s).  It  then  divides  each 
SPI  Into  generalized  tasks  called  Human  Performance  Functions  (HPF’s) 
which  are  performed  under  condition  sets. 

Following  the  completion  of  testing  of  a  group  of  tasks  (HPF’s),  it  is 
necessary  that  data  be  taken  as  to  the  difficulty  of  performing  those 
tasks.  This  should  be  done  immediately  following  completion.  There  are 
two  sources  of  this  data:  the  actual  participants  In  the  OT  (players),  and 
the  observers  of  the  task  performance. 

This  package  contains  (1)  'Task  (HPF)  Difficulty  Worksheets"  for  both 
participants  (player)  and  observers,  in  which  the  task  to  be  performed 
have  been  recorded;  (2)  "Performance  Difficulty  Questionnaires"  for  both 
participants  and  observers;  and  (3)  "Crlticaf  Incident  Reports."  "Critical 
Incident  Reports"  should  be  distributed  to  all  participants  and  observers 
to  be  completed  when  an  accident  or  near-accldent  occurs.  The  use  of  the 
other  contents  of  this  package  will  be  explained  In  the  following 
guide  I ines: 

(1)  Administer  the  'Task  (HPF)  Difficulty  Worksheet"  to  each 
participant  (player)  and  fill  the  appropriate  one  yourself 
immediately  following  comp  I et I on  of  testing  of  each  group  of 
tasks  (HPF’s)  performed  together.  This  administration  should 
take  place  as  soon  as  possible.  The  longer  the  time  between 
completion  and  administration,  the  more  information  that  is 
lost. 


SYSTEM 


TEST _ DATE _ PAGE 


NAME 


TELEPHONE 
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GUIDELINES  FOR  COLLECTING 
DATA  FOR  DIAGNOSIS  DURING  OT 


SYSTEM. 


NAME- 


This  administration  consists  of  each  participant  and  observer 
rating  the  difficulty  of  performance  of  each  task  on  a  0-100 
scale:  A  rating  of  50  or  above  means  that  the  rater  considers 
the  task  reasonably  difficult.  When  this  is  the  case,  it  is 
necessary  to  find  out  the  cause  of  the  difficulty. 


(2)  When  a  task  is  rated  50  or  above  by  any  participant  (player) 

or  observer,  that  individual  then  completes  either  the  "Performance 
Difficulty  Questionnaire"  for  that  task.  To  prepare  this  question¬ 
naire,  fill  in  the  information  at  the  top  of  the  first  page  and 
the  appropriate  conditions  for  #19. 


(3)  Return  all  completed  questionnaires,  worksheets,  and  "Critical 
Incident  Reports"  to  the  sender. 
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TASK  (HPF)  DIFFICULTY  WORKSHEET 
FOR  OT  PARTICIPANTS  (PLAYERS) 


SYSTEM  FUNCTION 


□  OPER 

□  maint 


CONDITION  SET 


TASKS  (HPF's)  PERFORMED  TOGETHER 


DIFFICULTY 

SCORE 


Rate  each  task,  listed  above,  for  performance  difficulty  from  1  to  100.  A 
rating  of  1  means  you  think  that  a  task  was  extremely  easy  to  perform.  A 
rating  of  100  means  you  think  that  a  task  was  extremely  difficult  to  perform. 
If  you  rate  a  task  50  or  above,  you  are  concerned  about  its  difficulty.  None 
of  these  ratings  mean  you  could  not  perform  a  task.  You  may  choose  any  score 
I  from  1-100. 

1  50  100 


EXTREMELY 

EASY 

TO  PERFORM 


DIFFICULT  ENOUGH 
TO  CAUSE  SOME 
CONCERN 


EXTREMELY 
DIFFICULT 
TO  PERFORM 


SYSTEM 


5 

NAME 

TELEPHONE 

V 

i 
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TASK  (HPF)  DIFFICULTY  WORKSHEET 
FOR  OT  OBSERVERS 


SYSTEM  FUNCTION 


OPER 
MAI  NT 


CONDITION  SET 


TASKS  (HPF's)  PERFORMED  TOGETHER 


DIFFICULTY 

SCORE 


Rate  each  task,  listed  above,  for  performance  difficulty  from  1  to  100.  A 
rating  of  1  means  you  think  that  a  task  was  extremely  easy  to  perform.  A 
rating  of  100  means  you  think  that  a  task  was  extremely  difficult  to  perform. 
If  you  rate  a  task  50  or  above,  you  are  concerned  about  its  difficulty.  None 
of  these  ratings  mean  a  task  could  not  be  performed.  You  may  choose  any 
score  from  1-100. 

1  50  100 


EXTREMELY 

EASY 

TO  PERFORM 


DIFFICULT  ENOUGH 
TO  CAUSE  SOME 
CONCERN 


EXTREMELY 
DIFFICULT 
TO  PERFORM 


SYSTEM 

NAME 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


NAME:  _ 

DATE:  _ 

CONDITION  SET; 


TASK 


You  have  just  observed:  _ _ 


and  have  said  that  it  was  difficult  to  do.  Answer  the  following  questions, 
about  this  task  by  assigning  rating  scores  to  them. 

1.  UNDERSTANDING  PROCEDURE 

How  difficult  was  understanding  what  participants  (players)  were 
supposed  to  do  and  how  they  were  supposed  to  do  it  for  the  specific 
task  I i sted  above? 


COMPLETELY 

SATISFACTORY 

100 

Understanding  was 
no  prob I em,  at  all 


IN  BETWEEN 
50 

It  was  moderately 
d  iff Icult  to  under¬ 
stand 


COMPLETELY 

UNSATISFACTORY 

0 

It  was  so  difficult 
that  it  was  not 
possible  to  adequate¬ 
ly  understand 


2.  READING/HEARING  DISPLAYS 


How  well  could  participants  (players)  read  and/or  hear  the  displays  which 
were  required  for  the  performance  of  this  task? 


COMPLETELY 

SATISFACTORY 

100 

Readab I e/hearab I e 
without  effort 


IN  BETWEEN 
50 

Moderate  effort 
needed  for  d i sp I  ays 


COMPLETELY 

UNSATISFACTORY 

0 

Impossible  to  ade¬ 
quately  read  and/or 
he»r  displs^ys 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


3.  UNDERSTANDING  DISPLAYS 

How  well  could  participants  understand  the  information  which  was 
presented  by  the  displays  during  this  task  performance? 


COMPLETELY 

SATISFACTORY 

100 

Extremely  easy 
to  understand 


IN  BETWEEN 
50 

Moderately  difficult 
to  understand 


4.  USEFULLNESS  OF  DISPLAY  INFORMATION 


COMPLETELY 

UNSATISFACTORY 

0 

Presentation  of  infer- 
mation  so  difficult 
that  it  could  not  be 
adequately  understood 


How  effectively  did  the  display(s)  used  during  this  task  deliver  the 
right  information  and  in  a  timely  way?  i - 1 


COMPLETELY 

SATISFACTORY 

100  75 

All  information  needed 
for  this  performance 
was  provided  at  the 
right  time 

5,  MANIPULATION  DIFFICULTY 


IN  BETWEEN 

50  : 

The  majority  of  the 
required  information 
was  delivered,  usually 
in  time 


COMPLETELY 
UNSAT  I S FACTORY 
0 

Information  delivered 
was  either  completely 
inadequate,  incorrect, 
or  so  late  as  to  be 
use  I  ess 


Check  any  problems  encountered  when  frying  to  manipulate  the  control (s), 
or  atiy  other  piece  of  equipment,  during  the  performance  of  this  task: 

□  Too  hard  to  move,  too  much  effort  required. 

□  Movement  required  unreasonable  amount  of  dexterity. 

I  I  Too  many  other  thinks  required  at  the  same  time. 

□  Too  easy  to  make  a  mistake. 

□  Movement  different  than  what  is  reasonable  to  expect. 

I  I  Movement  requires  unavailable  tool(s). 

□  Other,  specify  _ _ _ 


I>J 


MANIPULATION  DIFFICULTY  (Continued) 

How  effectively  could  participants  actually  make  the  required  movements 
with  either  the  controls  ^  any  other  piece  of  equipment  involved  in 
the  performance  of  this  task? 


COMPLETELY 

SATISFACTORY 

100  75 

Contro I /equ i pment  move¬ 
ments  required  caused 
absolutely  no  difficulty 
of  any  kind 

6.  REACH/ACCESSIBILITY 


IN  BETWEEN 
50 


COMPLETELY 

UNSATISFACTORY 

0 

Movements  required  were 
so  difficult  that  they 
could  not  be  made 
adequate  I y 


Check  any  problems  encountered  when  trying  to  reach  the  control (s),  or 
any  other  piece  of  equipment  which  had  to  be  manipulated,  during  this 


□  Too  far  away  to  reach  resonably. 

□  Angle  to  it  was  such  that  it  could  not  be  reasonably  reached. 

□  It  was  fully  or  partially  blocked  by  another  object. 

□  It  was  fully  or  partially  blocked  by  another  person. 

□  Reaching  it  forced  exposure  to  hazardous  or  highly  uncomfortable 
objects  (excessively  hot,  excessively  cold,  sharp,  etc.) 

□  Other,  specify  _ 


How  effectively  could  participants  reach  and  get  at  the  control (s)  or  any 
other  piece  of  equipment  which  had  to  be  manipulated  for  the  performance 


of  this  task? 

COMPLETELY 

SATISFACTORY 

100  75 

Controls/other  pieces 
of  equipment  were 
accessible  without 
effort 


□ 


IN  BETWEEN 

50  25 

Controls/other  pieces 
of  equipment  were 
access! b I e  with 
moderate  effort 


COMPLETELY 

UNSATISFACTORY 

0 

Not  access  i  b  I  e  fromeither 
my  assigned  position  or 
any  other  position  which 
did  not  interfere  with  i 
my  performance  A 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


CONTROL  CONFIGURATION 

Check  any  problems  encountered  wth  the  configuration  of  the  control (s), 
or  any  other  piece  of  equipment  which  had  to  be  manipulated,  during 
this  task; 

□  Too  hard  to  find. 

□  Too  hard  to  determine  what  it  was. 

□  Too  close  to  other  control /equipment. 

□  Too  far  from  other  control /equipment  used  in  same  performance. 

df Used  without  looking  at  it  much,  and  it  felt  too  much  like  others. 

□  Too  hard  to  tell  when  it  was  activated  or  moved  to  correct  position, 

□  Other,  specify  _ 

How  useful  was  the  actual  configuration  of  the  control,  or  other  piece 
of  equipment  which  had  to  be  moved,  for  performance  of  this  task? 


COMPLETELY 
SAT  I SFACTORY 

100  75 

Configuration  caused 
absol utel y  no  diffi¬ 
culty  of  any  kind 


IN  BETWEEN 

50  25 

Configuration  had  prob¬ 
lems,  but  caused  only 
moderate  difficulty 


J  COMPLETELY 
UNSATISFACTORY 
0 

Configuration  so  poor 
it  made  performance 
imoossibly  difficult 


8.  DECISION  DIFFICULTY 

How  difficult  was  it  to  make  the  dec i s ions  which  were  required  for 
performance  of  this  task?  n 


COMPLETELY 
SAT  I SFACTORY 
100 

Required  decisions 
were  very  easy  to 
Up 


;n  between 
50 

Req u i red  dec i s i on  s 
were  moderately 
di  f  icult  +o  make 


COMPLETELY 

UNSATISFACTORY 

C 

Required  decisions  wen- 
so  difficulty  t  -  ?.  *  *  •  c  . 
could  nmt  hP  ma.'-'c. 

adeauate i v 


■  y. 


■  *’ 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


9.  TARGET/TERRAIN  VISIBILITY 


How  we  I  I  could  participants  see  targets  or  any  other  elements  of  the 


external  environment  which  were  required  for  performance  of  this  task? 


COMPLETELY 

SATISFACTORY  IN  BETWEEN 

100  75  50 


25 


COMPLETELY 
UN S ATI SFACTORY 
0 


Visibility  was  excel¬ 
lent.  It  was  easy  to 
see  all  reauired  oarts 
of  the  environment, 
including  targets 


Visibility  was  ade¬ 
quate.  Enough  could 
be  seen  to  permit 
the  perf<^rmance 


Visibility  was  unaccep 
table.  Targets  and/or 
critical  parts  of  the 
environment  could  not 
be  seen 


10.  WORKSTATION  DESIGN  FOR  VISIBILMY 

Check  any  visibility  problems  encountered  during  this  task  caused  by  the 
work  station  design: 

□  Not  enough  light  on  outside  of  workstation. 

□  Wi  ndow/port  not  big  enough. 

□  W  i ndow/port  not  in  right  place. 

□  Window/port  too  dirty  or  distorted. 

□  Equ ipment/peop 1 e  in  the  way  of  wi ndow/port. 

□  Not  enough  I ight  inside  work  station. 

□  Too  much  glare. 

□  Important  equipment  behind  other  equipment  or  people. 

I  I  Viewing  angle  from  seat  to  equipment  not  good. 

I  I  Other:  _ 


_ / 

TEST _ DATE _ PAGE 

TELEPHONE _ 


SYSTEM 

NAME- 


W6-22 


WORKSTATION  DESIGN  FOR  VISIBILITY  (Continued) 


The  design  of  some  parts  of  the  work  station  probably  had  an  Impact  on 
participant’s  ability  to  see.  What  was  the  effect  of  those  parts  of 
the  work  station  on  the  performance  of  this  task? _ 

COMPLETELY  □  COMPLETELY 

SATISFACTORY  IN  BETWEEN  UNSATISFACTORY 

100  75  50  25  0 

Visual  parts  of  Visual  parts  of  work  Visual  parts  of  wor 

work  station  pro-  station  produced  station  so  poor  tha 

duced  no  difficulty  moderate  difficulty  performance  impossi 

of  any  kind  in  performance  difficult 


_J  COMPLETELY 
UNSATISFACTORY 
0 

Visual  parts  of  work 
station  so  poor  that 
performance  impossibly 
difficult 


11.  NOISE 


Check  any  noise  problems  encountered  during  this  task. 


I  f  Could  not  hear  radio  or  other  device  which  had  to  be  heard, 

□  Could  not  hear  other  crew  members. 

□  Noise  produced  fatigue. 

I  I  Noise  disturbed  concentration. 

□  Noise  produced  discomfort. 

□  Noise  gave  away  location. 

I  I  Other: _ 


What  was  the  effect  of  noise  in  the  workstation  on  the  performance  of 


this  task? 


COMPLETELY 
SAT  I SFACTORY 
100 

Noise  produced  no 
diff  iculty  of  any 
kind 


□ 


IN  BETWEEN 

50  25 

Noise  produced  moderate 
difficulty  in  perfor¬ 
mance 


COMPLETELY 

UNSATISFACTORY 

0 

No i se  so  extreme  that 
performance  impossibly 
d  iff icult 


j--' 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


12.  MOTION 


Check  any  motion  problems  encountered  during  this  task: 

□  Vibration  affected  accurate  use  of  controls. 

□  Vibration  affected  accurate  reading  of  displays. 

□  Constant  vibration  produced  fatigue. 

□  V  ibration  affected  detect i on /i dent i f icat ion  of  objects  outside  the 
workstation. 

□  Acceleration  too  great  for  the  kind  of  seat  support. 

□  Acceleration  prevented  reaching  control, 
a  Acceleration  prevented  seeing  display. 

□  Motion  produced  sickness. 

f  I  Other:  _ _ _ 

What  was  the  effect  of  motion  at  the  workstation  on  the  performance  of 
this  task?  I - 1 


COMPLETELY 

SATISFACTORY 

100 

Motion  produced 
no  diff iculty  of 
anv  kind 


IN  BETWEEN 
50 

Motion  produced 
moderate  difficulty 
in  oerformance 


— '  COMPLETELY 
UNSAT  I SFACTORY 
0 

Motion  made  the  perfor¬ 
mance  impossibly  diffi¬ 
cult 


SYSTEM. 


NAME- 


-TELEPHONE. 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


13.  VENTILATION 

Check  any  ventilation  problems  encountered  during  this  task: 

□  Much  too  hot. 

□  Much  too  cold. 

□  Much  too  humid. 

□  Not  enough  fresh  air  flow. 

□  Exhaust  fumes  too  strong. 

□  Gun/rocket  fire  products  too  strong. 

□  Bad  odors  produced  nausea. 

i  I  Other:  _ 


What  was  the  effect  of  ventilation  in  the  work  station  on  the 


performance  of  this  task? 


COMPLETELY 
SAT  I SFACTORY 
100 

Vent  i  I  at  ion  pro¬ 
duced  no  difference 
of  anv  kind 


IN  BETWEEN 
50 

Vent  i  I  at  ion  produced 

moderate  difficulty 
in  performance 


COMPLETELY 
UNSAT  I SFACTORY 
0 

Ventilation  so  inade¬ 
quate  that  performance 
imooss i b I e 


SYSTEM , 


NAME. 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


14.  WORKSTATION  DIMENSIONS 

Check  any  problems  with  the  dimensions  of  the  workstation  encountered 
during  this  task: 

□  Work  surface  too  sma II.  I 

1  I  Work  surface  in  wrong  place. 

□  Work  surface  at  wrong  height  or  angle.  I 

□  Not  enough  space  to  work  because  of  equipment,  or  space  a  I  lowed.  I 

□  Not  enough  space  to  work  because  of  crowding  with  other  crew  members.  I 

□  Poor  arrangement  of  equipment.  I 

□  Hatches  too  sma II.  I 

□  Hatches  in  wrong  places.  I 

I  I  Other: _ 


What  effect  did  the  dimensions  of  the  work  station  have  on  the  perform¬ 


ance  of  this  task? 

COMPLETELY 

SATISFACTORY 

100  75 

Dimensions  pro¬ 
duced  no  difficul¬ 
ties  of  any  kind 


IN  BETWEEN 

50  25 

Dimensions  produced 
moderate  difficulty 
in  performance 


□ 

I - 1  COMPLETELY 

UNSATISFACTORY 

0 

Dimensions  so  poor 
that  performance 
impossibly  difficult 


SYSTEM. 

NAME- 


.TEST. 


.DATE. 


.PAGE 


-TELEPHONE. 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


HRT€S 


15,  SEATING 


Check  any  seating  problems  encountered  during  this  task: 

□  Seat  too  narrow. 

□  Seat  at  wrong  height. 

□  Not  enough  back  support. 

□  Seat  back  angle  not  right. 

□  Needs  arm  supports. 

□  Needs  foot  supports. 

□  Not  enough  head  space. 

□  Not  enough  shoulder  space. 

□  Not  enough  leg  space. 

□  Not  enough  foot  space. 

□  Seat  does  not  absorb  vibrations  well  enough. 

□  Seat  uncomf ortab I e  and  makes  you  tired. 

I  I  Seat  needs  to  move  or  move  more. 

I  I  Other:  _ 


What  effect  did  the  seating  have  on  the  performance  of  this  task? 


COMPLETELY 

SATISFACTORY 

100 

Seating  produced 
no  difficulty  of 
any  kind 


IN  BETWEEN 
50 

Seating  produced 
moderate  difficulty 
in  performance 


COMPLETELY 

UNSATISFACTORY 

0 

Seating  so  poor  that 
performance  impossibly 
difficult 


SYSTEM. 


NAME- 


^  i  I*  K  >  •  -  •  ih  *  L  J 


-TELEPHONE- 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


HRTES 


16.  SAFETY  HAZARDS 

Check  any  safety  hazards  encountered  at  the  workstation  during  this  task: 

Sharp,  jagged,  pointed  object(s). 

Dangerous  lack  of  head  clearance. 

Dangerously  hot  material  exposed. 

Source  of  electric  shock  exposed. 

Poisonous  material  exposed. 

Moving  machinery  exposed. 

So  little  light  that  accident  could  result. 

Glare  so  bright  that  accident  could  result. 

Dangerously  high  noise  level. 

Dangerous  lack  of  ventilation. 

Anchoring  of  equipment  not  adequate. 

Padding  of  equipment  not  adequate. 

Crew  seat  bel ts/restralnts  not  adequate. 

Slippery  walking  or  climbing  surface. 

Handholds  for  lifting  or  climbing  not  adequate. 

Footholds  for  climbing  not  adequate. 

No  adequate  signal  when  equipment  operation  becomes  dangerous. 

No  adequate  signal  when  outside  situation  becomes  dangerous. 

Other : _ ' 

Safety  hazards  can  have  two  possible  effects  on  performance — (I)  they  can 
produce  actual  injury  which  keeps  performance  from  being  adequate,  and 
(2)  they  can  produce  worry  about  injury  which  keeps  performance  from 
being  adequate.  Complete  the  Safety  Hazard  scale  on  the  next  page. 


HRTGS 


PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


SAFETY  HAZARDS  (Continued) 

What  was  the  effect  of  safety  hazards  on  the  performance  of  this  task? 


COMPLETELY 

SATISFACTORY 

100  75 

Safety  hazards  pro¬ 
duced  no  difficulty 
of  any  kind 

17.  TRAINiNG  TIME 


IN  BETWEEN 
50 

Safety  hazards  pro¬ 
duced  moderate  diffi¬ 
culty  in  performance 


COMPLETELY 
'  UNSATISFACTORY 
0 

Safety  hazards  so 
extreme  that  perfor¬ 
mance  impossible 


To  what  extent  did  participants  spend  adequate  time  training  for  this 


task? 


COMPLETELY 

SATISFACTORY 

100  75 

Did  not  require  any 

more  tra i n i nq  time 
at  3  n 


□ 


IN  BETWEEN 
50 

Got  almost  enough 
training  time  for 
this  performance; 
I ittle  more  woul d 
have  been  helpful 


- '  COMPLETELY 

UNSAT  I SFACTORY 
0 

Got  no  tra i n i ng  time 
for  the  performance  of 
this  tasK 


18.  PRACTICE  CONDITIONS 

To  what  extent  did  participants  practice  for  this  task  in 


COMPLETELY 

SATISFACTORY 

100 

Had  an  adequate 
amount  of  practice 
of  this  task  in 
th is  cond it  ion 


(condition) 


IN  BETWEEN 
50 

Practiced  this  task 
in  this  cond it  ion , 
or  a  very  similar 
one.  Could  have  used 
more  trainina  time 


□c 


1 _ I  COMPLETELY 

UNSATISFACTORY 

0 

Got  no  practice  of  this 
task  in  this  condition 


SYSTEM. 


NAME. 


-TELEPHONE. 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
11  r\  I  (FOR  OBSERVERS)  (CONTINUED) 

— 


19.  TRAINER 

How  effective  was  the  trainer  In  training  this  task? 


COMPLETELY 

SATISFACTORY 

100 

Trainer  did  as 
good  a  job  train¬ 
ing  this  task  as 
was  necessary 


IN  BETWEEN 
50 

Trainer  did  a  res¬ 
ponsible  job  of 
training  this  task 


□  COMPLETELY 
UNSATISFACTORY 
0 

Trainer  was  unab I e 
to  teach  this  task 


20.  TRAINING  METHOD(S) 

How  was  this  task  trained? 


n  Lecture 

a  Film  or  other  audio-visual  method 

□  Reading  printed  material 

□  Paper  and  pencil  workbook 

□  Practice  in  a  simulator 

I  I  Watching  someone  doing  it 
I  j  Doing  it  yourself  with  the  actual  hardware 

□  Other  (specify):  _ 


How  effective  do  you  think  this  kind  of  training  is  for  this  task? 


COMPLETELY 

SATISFACTORY 

100  75 

The  best  method  for 
training  th is  task 


IN  BETWEEN 
50 

Could  learn  the  task 
with  this  method,  but 
it  could  have  been  im¬ 
proved  a  little 


COMPLETELY 
UNSATISFACTORY 
25  0 

Method  provided  no  help 
in  learning  how  to  actua I 
l\/  do  this  task 


SYSTEM , 
NAME- 


JEST. 


DATE. 


.PAGE 


.TELEPHONE 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
I  II  \  I  OBSERVERS)  (CONTINUED) 


21 .  WORKLOAD 

To  what  extent  was  there  too  much  work  to  do  In  the  time  allotted 
considering  everyth ing  being  done  at  the  time  of  this  task  performance? 
This  includes  other  activities  that  were  being  performed  at  the  same 
time. 


COMPLETELY  COMPLETELY 

SATISFACTORY  IN  BETWEEN  UNSATISFACTORY 

100  75  50  25  0 


Workload  perfectly 
adequate  during 
performance 


Moderate  performance 
difficulty  caused  by 
workload.  Player 
fully  loaded. 


Tota My  I nade- 
quate  workload 
made  task 
performance 
impossible 


J 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
(FOR  OBSERVERS)  (CONTINUED) 


TO  THE  TEST  OBSERVER,  OR  OTHER  APPLICABLE  OT  PERSONNEL: 

If  there  are  other  places  of  information  which  you  believe  are  applicabi 
and  important  to  this  field  test,  write  them  here. 


HRTES 


PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS) 


TASK  (HPF) 


DATE: 


CONDITION  SET: 


SYSTEM  FUNCTION: 


You  have  just  completed: 


and  have  said  that  it  was  difficult  to  do.  Answer  the  following  questions, 
about  this  task,  by  assigning  rating  scores  to  them. 


1.  UNDERSTANDING 

How  difficult  was  understanding  what  you  were  supposed  to  do  and  how 
you  were  supposed  to  do  it  for  the  specific  task  listed  above? 


COMPLETELY 

SATISFACTORY  IN  BETWEEN 

100  75  50 

Understanding  was  it  was  moderately 

no  problem,  at  all  difficult  to  under¬ 
stand 


□ 


COMPLETELY 
_J  UNSATISFACTORY 
0 

It  was  so  difficult 
that  it  was  not 
possible  to  adequate¬ 
ly  understant 


2.  READING/HEARING  DISPLAYS 

How  well  could  you  read  and/or  hear  the  displays  which  were  required 
for  the  performance  of  this  task? 


COMPLETELY 

SATISFACTORY 

100  75 

Readab I e/hearab I e 
without  effort 


IN  BETWEEN 
50 

Moderate  effort 
needed  for  displays 


COMPLETELY 
UNSAT  I SFACTORY 


Impossible  to  adequately 
read  and/or  hear  displays 


SYSTEM 


NAME 


-TELEPHONE 


PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
I  ir\  I  •"OR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


3.  UNDERSTANDING  DISPLAYS 

How  well  could  you  understand  the  information  which  was  presented  by 
the  displays  during  this  task  performance?  I - 1 


COvIPLETELY 

SATISFACTORY 

100 

Extremely  easy 
to  understand 


IN  BETWEEN 
50 

Moderately  difficult 
to  understand 


□ 


- -  COMPLETELY 

UNSATISFACTORY 

0 

Presentation  of 

information  so  diff 
cult  fh!=>f  it  could 
not  be  adequately 
understood 


4.  USEFULLNESS  OF  DISPLAY  INFORMATION 

How  effectively  did  the  display(s)  used  in  this  task  deliver  the 
right  information  and  in  a  timely  way?  i— — I 


COMPLETELY 

SATISFACTORY 

100 

A I  I  i n format  ion 
needed  for  th i s 
performance  was 
provided  at  the 
right  time 


IN  BETWEEN 
50 

The  majority  of  the 
required  information 
was  delivered,  iisiisliy 
in  time 


□ 


' - '  COMPLETELY 

UNSATISFACTORY 

0 

Information  delivered 
was  either  completely 
inadequate,  incorror-t^ 
or  so  late  as  to  be 
use  I  ess 


MANIPULATION  DIFFICULTY 

Check  any  problems  encountered  when  trying  to  manipulate  the  control (s), 
or  any  other  piece  of  equipment,  during  the  performance  of  this  task: 


I  t  Too  hard  to  move,  too  much  effort  required. 

□  Movement  required  unreasonable  amount  of  dexterity. 

I  I  Too  many  other  things  required  at  the  same  time. 

□  Too  easy  to  make  a  mistake. 

□  Movement  different  than  what  is  reasonable  to  expect. 

□  Movement  requires  unavailable  tool(s). 

□  Other,  specif 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


5.  MANIPULATION  DIFFICULPi'  (Continued) 

How  effectively  could  you  actually  make  the  required  movements  with  either 
the  controls  0£  any  other  piece  of  equipment  involved  in  the  performance 
of  this  task?  j - 1 

COMPLETELY  ' - 1  COMPLETELY 

SATISFACTORY  IN  BETWEEN  UNSATISFACTORY 

1 00  75  50  25  0 

Contro I /equi pment  It  was  possible  to  Movements  required 

movements  required  make  the  required  were  so  difficult 

caused  absolutely  movements  or  controls/  that  they  could  not 

no  difficulty  of  equipment  with  moder-  5©  made  adequately 

any  kind  ate  difficulty 


IN  BETWEEN 
50 

It  was  possible  to 
make  the  required 
movements  or  controls/ 
equipment  with  moder¬ 
ate  difficulty 


- '  COMPLETELY 

UN SAT  I S FACTORY 
0 

Movements  required 
were  so  difficult 
that  they  could  not 
be  made  adequately 


REACH/ACCESSIBILITY 

Check  any  problems  encountered  when  trying  to  reach  the  control (s),  or 
any  other  piece  of  equipment  which  had  to  be  manipulated,  during  this 
task: 


□  Too  far  away  to  reach  reasonably. 

□  Angle  to  it  was  such  that  it  could  not  be  reasonably  reached. 

□  It  was  fully  or  partially  blocked  by  another  object. 

□  It  was  fully  or  partially  blocked  by  another  person. 

□  Reaching  it  forced  exposure  to  hazardous  or  highly  uncomfortable 
objects  (excessively  hot,  excessively  cold,  sharp,  etc.) 

□  Other,  specify:  _ _ _ 


How  effectively  could  you  reach  and  get  at  the  control (s)  or  any  other 
piece  of  equipment  which  had  to  be  manipulated  for  the  performance  of 
this  task? 
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I  PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 

I  ||  \  I  for  participants  (players)  (continued) 

/ - 


6.  REACH/ACCESSIBILITY  (Continued) 


COMPLETELY 

SATISFACTORY 

100  75 

Controls/other  pieces 
or  equipment  were 
accessible  without 
effort 


IN  BETWEEN 

50  25 

Controls/other  pieces 
of  equipment  were 
accessible  with  moder¬ 
ate  effort 


□ 

' - •  COMPLETELY 

UNSATISFACTORY 

0 

Not  accessible  from  either 
my  assigned  position  or 
any  other  noeition  which 
did  not  interfere  with 
my  performance 


7.  CONTROL  CONFIGURATION 

Check  any  problems  encountered  with  the  configuration  of  the  control (s), 
or  any  other  piece  of  equipment  which  had  to  be  manipulated,  during 
this  task: 


o  Too  hard  to  find, 
a  Too  hard  to  determine  what  it  was. 

□  Too  close  to  other  control /equipment. 

□  Too  far  from  other  control /equ ipment  used  In  same  performance. 

□  Used  without  looking  at  it  much,  and  it  felt  too  much  like  others. 

i  I  Too  hard  to  tel  I  when  it  was  activated  or  moved  to  correct  position. 

□  Other,  specify: _ _ _ _ 


How  useful  was  the  actual  configuration  of  the  control,  or  other  piece 
of  equipment  which  had  to  be  moved,  for  the  performance  of  this  task? 


COMPLETELY 

SATISFACTORY 

100  75 

Conf  iguration  caused 
absol ute I y  no  di f f i - 
cu I  tv  of  anv  k i nd 


IN  BETWEEN 

50  25 

Configuration  had  prob¬ 
lems,  but  caused  only 
moderate  difficulty 


□  COMPLETELY 
UN SAT  1 S FACTORY 
0 

Configuration  so  poor 
it  made  performance 
imnossihly  difficult 
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UES^TjCaC^  PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
I  ir\  I  PARTICIPANTS  (PLAYERS)  (CONTINUED) 

/ - 


8.  DECISION  DIFFICULTY 


How  difficult  was  it  to  make  the  decisions  which  were  required  for 


the  performance  of  this  task? 


COMPLETELY 

SATISFACTORY 

100  75 

Required  decisions 
were  very  easy  to 
make 


IN  BETWEEN 
50 

Required  decisions 
were  moderately 
difficult  to  make 


25 


COMPLETELY 

UNSATISFACTORY 

0 


Required  decisions 
were  so  difficult 
that  they  could  not 
be  made  adeauately 


9.  TARGET  VISIBILITY 


How  we I  I  could  you  see  targets  or  any  other  elements  of  the  externa  I 


envi ronment  which  were  required  for  the  performance  of  this  task? 


COMPLETELY 

SATISFACTORY 

100  75 


IN  BETWEEN 
50 


25 


□  COMPLETELY 
UNSATISFACTORY 
0 


Visibi I ity  was 
excel  lent.  It  was 
easy  to  see  a  I  I 
requ i red  parts  of 
the  environment, 
including  targets 


V. 


Visibi  I  ity  was  ade¬ 
quate .  Enough  could 
be  seen  to  permit 
the  performance 


Visibility  was  unac¬ 
ceptable.  Targets 
and/or  cr  ft  ica I 
parts  of  the  environ 
ment  could  not  be 


seen 


h 

1 

R 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 

FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 

10.  WORKSTATION  DESIGN  FOR  VISION 

Check  any  visibility  problems  encountered  during  this  task  caused  by 
the  workstation: 

□  Not  enough  I ight  on  outside  of  work  station. 

□  Wi  ndow/port  not  big  enough, 
a  Wi  ndow/port  not  in  right  place. 

□  Wi ndow/port  too  dirty  or  distorted. 

□  Equipment/people  in  the  way  of  w I ndow/port. 

□  Not  enough  light  inside  workstation. 

□  Too  much  glare. 

□  Important  equipment  behind  other  equipment  or  people. 

□  V  iewing  angle  from  seat  too  equipment  not  good. 

□  Other,  specify:  _ 

The  design  of  some  parts  of  your  workstation  probably  had  an  impact  on 
your  abil Ity  to  see.  What  was  the  effect  of  those  parts  of  the  work¬ 
station  on  the  performance  of  this  task?  I - , 


COMPLETELY 
SAT  I SFACTORY 

100  : 
V  i  sua I  parts  of 
workstation  pro¬ 
duced  no  diffirultv 
of  any  kind 


□ 


IN  BETWEEN 

50  2 

Visual  parts  of  work¬ 
station  produced  moder¬ 
ate  difficulty  in  per¬ 
formance 


- 1  COMPLETELY 

UNSAT  I SFACTORY 
0 

Visual  parts  of  work¬ 
station  so  poor  that 
performance  impos- 
siblv  difficult 


iYSTEM . 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


NOISE 

Check  any  noise  problems  encountered  during  this  task. 

□  Could  not  hear  radio. 

□  Could  not  hear  other  crew  members. 

□  Noise  produced  fatigue. 

a  Noise  disturbed  concentration. 

□  Noise  produced  discomfort. 

I  I  Noise  gave  away  location. 

□  Other,  specify:  _ 


What  was  the  effect  of  noise  in  the  workstation  on  the  performance  of 


this  task? 

COMPLETELY 
SAT  I SFACTORY 
100 

Noise  produced  no 
difficulty  of  any 
kind 


IN  BETWEEN 
50 

Noise  produced  moder¬ 
ate  difficulty  in 
oerformanre 


□ 


-  COMPLETELY 

UNSATISFACTORY 

0 

Noise  so  extreme  that 
performance  Impossibly 
difficult 


MOTION 

Check  any  motion  problems  encountered  during  this  task. 

□  Vibration  affected  accurate  use  of  controls. 

□  Vibration  affected  accurate  reading  of  displays. 
r~i  Constant  vibration  produced  fatigue. 

□  Vibration  affected  detection/identif icat ion  of  objects  outside  the 
workstation . 

□  Acceleration  too  great  for  the  kind  of  seat  support. 

□  Acceleration  prevented  reaching  control . 

□  Acceleration  prevented  seeing  display. 

□  Kind  of  motion  nausea. 

□  Other,  specify:  _ 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


12.  MOTION  (Continued) 

What  was  the  effect  of  motion  at  your  workstation  on  the  performance 
of  this  task? 


COMPLETELY 

SATISFACTORY 

100 

I  Motion  produced 
no  difficulty 
of  anv  kind 


IN  BETWEEN 
75  50 

Motion  produced  moder¬ 
ate  difficulty  in 
oerformance 


25 


COMPLETELY 
UNSATISFACTORY 
0 

Motion  made  the  per¬ 
formance  Impossibly 
dl ++ i^ul+ 


13. 


VENTILATION 

Check  any  ventilation  problems  encountered  during  this  task: 

□  Much  too  hot. 

□  Much  too  cold. 

□  Much  too  humid. 

□  Not  enough  fresh  air  flow. 

□  Exhaust  fumes  too  strong. 

□  Gun/rocket  fire  products  too  strong. 

□  Bad  odors  produced  nausea. 

□  Other,  specify: _ _ _ 


What  was  the  effect  of  ventilation  in  the  workstation  on  the  performance 
of  this  task? 


COMPLETELY 
[SATISFACTORY 
100 

Ventilation  pro¬ 
duced  no  difficulty 
of  any  k i nd 


IN  BETWEEN 
75  50 

Ventilation  produced 
moderate  difficulty 
in  oerformance 


25 


COMPLETELY 
UNSAT  I SFACTORY 
0 

Ventilation  so  inade¬ 
quate  that  performance] 
impossib le 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


14.  WORKSTATION  DIMENSIONS 

Check  any  problems  with  the  dimensions  of  the  workstation  encountered 
during  this  task: 

□  Work  surface  too  small. 

I  i  Work  surface  in  wrong  place. 

□  Work  surface  at  wrong  height  or  angle. 

□  Not  enough  space  to  work  because  of  equipment,  or  space  ai lowed. 

□  Not  enough  space  to  work  because  of  other  crew  members. 

□  Poor  arrangement  of  equipment. 

□  Hatches  too  sma I  I . 

□  Hatches  in  wrong  places. 

□  Other,  specify:  _ 


What  effect  did  the  dimensions  of  your  workstation  have  on  the  performance 


of  this  task? 

COMPLETELY 

SATISFACTORY 

100  : 
Dimensions  pro¬ 
duced  no  diffi¬ 
culties  of  any  kind 


□ 


IN  BETWEEN 
50 

Dimensions  produced 
moderate  difficulty 
in  Derformance 


— '  COMPLETELY 
UNSATISFACTORY 
0 

Dimensions  so  poor 
that  performance 
impossibly  difficult 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


15.  SEATING 

Check  any  seating  problems  encountered  during  this  task: 


Q Seat  too  narrow. 

□  Seat  at  wrong  height. 

I  i Not  enough  back  support. 

Q Seat  back  angle  not  right. 

Q Needs  arm  supports. 

Q Needs  foot  supports. 

QNot  enough  head  space. 

I  I  Not  enough  shoulder  space. 

QNot  enough  leg  space. 

[[^Not  enough  foot  space. 

QSeat  does  not  absorb  vibrations  well  enough. 
QSeat  uncomfortable  and  makes  you  tired. 

Seat  needs  to  move  or  move  more. 

□  Other,  specify:  _ 


What  effect  did  the  seating  have  on  the  performance  of  this  task? 


COMPLETELY 
SAT  1 SFACTORY 

100  75 

Seating  produced 
no  difficulty  of 
any  kind 


IN  BETWEEN 

50  25 

Seating  produced  moder¬ 
ate  difficulty  in  per¬ 
formance 


COMPLETELY 
UN SAT  1 SFACTORY 
0 


Seating  so  poor  that 

performance  impossibly 
difficult 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


you  spend  adequate  time  training  for  this  task? 


17.  TRAINING  TIME 

To  what  extent  did 

COMPLETELY 
SAT  I SFACTORY 

100  75 

Did  not  require  any 
more  train ing  time 
at  a  I  1 


IN  BETWEEN 

50  25 

Got  almost  enough  train¬ 
ing  time  for  this  per¬ 
formance;  a  little  more 
would  have  been  helpful 


COMPLETELY 

UNSATISFACTORY 

0 

Got  no  training  time 
for  the  performance 
of  this  task 


you  practice  for  this  task  in 

? 

(condition) 


18.  PRACTICE 

To  what  extent  did 


COMPLETELY 

SATISFACTORY 

100  75 

Had  an  adequate 
amount  of  practice 
of  this  task  i n 
th  i  s  cond i t ion 


IN  BETWEEN 

50  25 

Practiced  this  task 
in  this  condition,  or 
a  very  similar  one.  Could 
have  used  more  training 
t  ime 


COMPLETELY 

- UNSATISFACTORY 

0 

Got  no  practice  of 
th  is  task  in  this 
condition 


19.  TRAINER 


How  effective  was  the  tra iner  in  training  this  task? 


COMPLETELY 
SAT  I SFACTORY 

100  75 

Trainer  did  as  good 
a  job  training  this 
task  as  was  necessarv 


IN  BETWEEN 

50  25 

Trainer  did  a  respon¬ 
sible  Job  of  training 
this  task 


COMPLETELY 

- UNSATISFACTORY 

0 

Trainer  was  unab I e 
to  teach  this  task 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


16.  SAFETY  HAZARDS 

Check  any  safety  hazards  encountered  at  the  workstation  during  this  task: 


□  Sharp,  jagged,  pointed  object(s). 
n  Dangerous  lack  of  head  clearance. 

□  Dangerously  hot  material  exposed. 

□  Source  of  electric  shock  exposed. 

□  Poisonous  material  exposed. 

□  Moving  machinery  exposed. 

□  So  little  light  that  accident  could  result. 

□  Glare  so  bright  that  accident  could  result. 

□  Dangerously  high  noise  level. 

□  Dangerous  lack  of  ventilation. 

□  Anchoring  of  equipment  not  adequate. 

□  Padding  of  equipment  not  adequate. 

a  Crew  seat  belts/restraints  not  adequate. 
i  I  SI ippery  walking  or  cl imbing  surface. 

□  Handholds  for  lifting  or  climbing  not  adequate. 

□  Footholds  for  climbing  not  adequate. 

□  No  adequate  signal  when  equipment  operation  becomes  dangerous. 

□  No  adequate  signal  when  outside  situation  becomes  dangerous. 

□  Other,  specify: _ 


Safety  hazards  can  have  two  possible  effects  on  performance — (I)  they  can 
produce  actual  injury  which  keeps  performance  from  being  adequate,  and 


Tney  can  proauce  worry 


being  adequate, 
of  this  task? 

COMPLETELY 
SAT  1 SFACTORY 
100 

Safety  hazards  pro¬ 
duced  no  d  i  f  f  icu  I  ty 
of  any  kind 


What  was  the  effect  of  safety  hazards  on  the  performance 


IN  BETWEEN 

75  50  25 

Safety  hazards  produced 
moderate  difficulty  in 
performance 


COMPLETELY 
UNSATISFACTORY 
0 

Safety  hazards  so  ex¬ 
treme  that  perfor¬ 
mance  impossible 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


20 .  TRAIN! NG  METHOD 


How  was  this  task  trained? 


□  Lecture. 

I  I  Film  or  other  audio-visual  method. 

□  Reading  printed  material. 

□  Paper  and  pencil  workbook. 

□  Practice  in  a  simulator. 

□  Watching  someone  doing  it. 

I  i  Doing  it  yourself  with  the  actual  hardware. 

□  Other,  specify;^ _ 


How  effective  do  you  think  this  kind  of  tra in ing  is  for  this  task? 


completely 

SAT  I S FACTORY 
100 

The  best  method 
for  train ing 
th  is  task 


IN  BETWEEN 
50 

Could  learn  the  task 
with  this  method,  but 
it  could  have  been 
improved  a  little 


□ 


COMPLETELY 

-  -UNSATISFACTORY 

0 

Method  provided  no 
help  in  learning  how 


to  actua I  I V  do  this 
tas'R 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


21.  WORKLOAD 


To  what  extent  was  the  work  load  adequate 
performed?  This  should  include  consider! 
performed  at  the  same  time  as  this  task. 


COMPLETELY 

SATISFACTORY 

100 


75 


IN  BETWEEN 
50 


Workload  perfectly 
adequate  during 
performance 


Moderate  performance 
difficulty  caused  bv 
workload.  You  were 
fully  loaded 


while  this  task  was  being 
ng  all  tasks  which  were 


COMPLETELY 
UNSAT  I SFACTORY 
25  0 


Totally  inadequate 
workload  made  task 
performance  impossibi 
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PERFORMANCE  DIFFICULTY  QUESTIONNAIRE 
FOR  PARTICIPANTS  (PLAYERS)  (CONTINUED) 


TO  THE  TEST  PARTICIPANT  (PLAYER): 

If  there  are  other  pieces  of  information  which  you  believe  are  applicable 
and  important  soout  this  field  test,  write  them  here. 


NAME 
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CRITICAL  INCIDENT  REPORT 


HRTGS 


WHAT  HAPPENED? 


WHAT  PRODUCED  THIS  PROBLEM? 


HOW  DID  YOU  DISCOVER  THIS  PROBLEM? 


HOW  DID  YOU.  OR  WOULD  YOU.  SOLVE  THIS  PROBLEM? 


WHAT  DID  IT,  OR  COULD  IT.  HAVE  CAUSED? 


□  PARTICIPANT 

□  OBSERVER 


OPINION  SUMMARY  DATA  WORKSHEET 


HRTeS 


SYSTEM  FUNCTION 


CONDITION  SET  if 


OPINION  SCALES  < 


1.  Understanding 
Procedures 


2.  Display  Readability/ 
Hearability  Measurement 


3.  Display  Information 
Understand i n 


4.  Usefulness  of  Display 
Information 


5.  Manipulation  Difficulty 


6.  Reach/Access i b  i  I  i ty 


7.  Control  Configuration 


8.  Decision  Difficulty 


10.  Workstation  Design  for 
Visibility  _ 


1 1 .  Sound 


12.  Motion 


13.  Venti I  at  ion 


14.  Workstation  Dimensions 


15.  Seating 


16.  Safety 


17.  Training  Time 


18.  Practice  Condition 


19.  TralnerCs) 


0.  Training  Method 


,  1.  Workload 
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STATISTIC  WORKSHEET 


□  OPER 

□  MAINT 


SYSTEM  FUNCTION 

SPI 

HPF 

CONDITION  SET(S) 

TYPE  OF  STATISTIC 


UNITS 


TRIALS 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

GRAND 

SUM 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

SUMS 

SUMS/ 

TRIALS 

STATISTIC  OUTCOME 
I'EVEL  OF  CONFIDENCE 
UPPER  CONFIDENCE  LIMIT 

LOWER  CONFIDENCE  LIMIT 
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2.  Value  Function  Worksheet 
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I  GUIDELINES  FOR  DEFINING 

liiiJL^  I  value  functions 

/ - 


You  have  received  a  package  of  worksheets.  Each  package  consists  of  a 
set  of  "Criterion  Worksheets,"  "Value  Function  Worksheets,"  "Final 
Condition  Sets  Worksheets,"  and  these  Guidelines.  Your  task  is  to  assist 
in  developing  Value  Functions  by  which  results  from  the  field  test  will 
be  evaluated.  For  each  statistic,  you  will  be  asked  to  develop  a  Va I ue 
Function.  By  means  of  these  Value  Functions  the  level  of  performance  of 
the  various  HPF’s  will  be  evaluated.  The  value  assigned  to  each  statistic 
outcome  is  a  number  between  0  and  100.  0  -  means  very  bad  performance; 

100  -  means  very  good  performance.  The  value  scale  will  look  as  follows: 

Very  Bad  Bad  Borderline  Good  Very  Good 

I - 1 - , - , - 1 

0  25  50  75  100 

On  the  "Criterion  Worksheet,"  Is  specified  what  constitutes  one 
successful  trial,  the  type  of  the  statistic,  and  the  statistic  criterion. 

One  point  on  each  Value  Function  is  determined  in  advance:  the  statistic 
criterion  point.  This  is  done  by  assigning  to  the  statistic  criterion  of 
each  HPF  the  value  50  (borderline).  This  preassignment  may  aid  you  in 
assessing  other  points  on  the  Value  Function.  You  will  be  asked  to 
determine  an  outcome  with  a  value  of  0  (very  bad)  and  an  outcome  with  a 
value  of  100  (very  good)  for  each  statistic.  From  those  determinations 
and  from  the  criterion  point,  an  approximated  Value  Function  for  each 
statistic  will  be  developed. 


Before  you  go  through  the  instructions,  consider  the  following  examples: 


HRT6S 


GUIDELINES  FOR  DEFINING 
VALUE  FUNCTIONS  (Continued) 


The  HPF  Is  "Target  Detection  and  Identification."  The  statistic  developed 
for  this  HPF  is  "Percentage  of  Successful  Trials."  The  definition  of  the 
performance  criterion  of  one  trials  and  the  condition  sets  are  specified, 
and  the  statistic  criterion  is  70?.  After  considering  the  performance 
criterion  and  condition  set,  you  and  some  other  experts  together  decided 
that  40?  of  successful  trials  is  very  bad  performance  and  95?  of  successful 
trials  is  very  good  performance  of  this  HPF.  Plotting  straight  lines 
between  the  given  points,  the  approximated  Value  Function  would  look  as 
fol lows: 


VALUE  SCALE 

VERY  GOOD  100 


GOOD  75 


BORDERLINE  50 


BAD  25 


VERY  BAD  Ol 

STATISTIC  SCALE 


VERY  BAD 
STATISTIC 
OUTCOME 


Toy. 


VERY  OOOO 
STATISTIC 
OUTCOME 


HRT6S 


GUIDELINES  FOR  DEFINING 
VALUE  FUNCTIONS  (Continued) 


Using  this  Value  Function,  the  value  of  the  statistic  outcome  would  be 
assessed.  For  example,  the  value  of  the  outcome  ■■  85$  of  successful 
trials  would  be  80,  and  would  be  determined  as  follows: 

VALUE  SCALE 


In  the  following  pa. agraphs,  specific  Guidelines  for  selecting  the  "very 
good"  and  "very  bad"  outcome  of  each  statistic  are  given: 

(1)  Determine  the  "very  good"  outcome  for  the  statistic  and  record 
it  in  the  appropriate  space  on  the  Worksheet. 
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GUIDELINES  FOR  DEFINING 
VALUE  FUNCTIONS  (Continued) 


For  each  statistic,  there  is  a  range  of  plausible  or  conceivable 
performance  which  you  consider  to  be  very  good.  As  the  goodness 
of  performance  increases,  usually  the  effectiveness  of  the 
system  increases.  This  relationship  between  increased  perfor¬ 
mance  goodness  and  increased  system  effectiveness  continues 
until  a  point  is  reached  at  which  the  increase  in  performance 
goodness  produces  only  negligible  additional  system  effectiveness. 
That  point  in  the  range  of  plausible  performance  is  the  "very 
good"  outcome.  In  the  previous  example,  95?  is  the  sma I  I est 
percentage  of  success  which  you  still  considered  to  be  very  good. 


Selecting  the  "very  good"  outcome  -  Determine  the  poorest  outcome 
of  the  statistic  in  question,  which  you  still  consider  to  be 
very  good.  This  statistic  outcome  is  given  the  value  of  100. 

This  may  be  done  using  any  strategy  with  which  you  feel  comfort¬ 
able.  If  you  want  some  aid,  the  following  is  one  possible 
strategy  for  selecting  the  "very  good"  outcome: 


(a)  For  each  statistic,  identify  some  clearly  unacceptable 
outcome  according  to  the  statistic  type  (percentage  or 
average),  and  then  identify  successively  better  statistic 
outcomes.  As  you  consider  these  better  outcomes,  ask 
yourself  the  following  two  questions: 


(1)  is  this  outcome  plausible;  could  it  really  be  expected 
to  take  place? 

(2)  Does  this  outcome  produce  additional  appreciable  system 
effectiveness  as  compared  with  the  last  previous 
outcome  I  considered? 
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GUIDELINES  FOR  DEFINING 
VALUE  FUNCTIONS  (Continued) 


(b)  If  the  answers  to  the  two  questions  above  are  both  "yes," 
you  have  not  yet  located  the  "very  good"  outcome.  Identify 
the  next  better  statistic  outcome.  If  the  answer  to  either 
of  these  two  questions  is  no,  the  last  previous  performance 
outcome  is  the  "very  good"  outcome. 

(2)  Determine  the  "very  bad"  outcome,  and  record  it  in  the  appro¬ 
priate  space  on  the  Worksheet. 

For  each  statistic  there  is  a  range  of  plausible  or  conceivable 
performance  which  you  consider  to  be  very  bad.  As  the  goodness 
of  performance  decreases,  usually  the  effectiveness  of  the  system 
decreases.  This  relationship  between  decreased  performance  and 
decreased  system  effectiveness  continues  until  a  point  may  be 
reached  at  which  the  decrease  in  performance  goodness  produces 
only  a  neq I i q i b I e  decrease  in  the  system’s  effectiveness.  That 
point,  in  the  range  of  plausible  performance,  is  the  "very  bad" 
outcome. 

Selecting  the  "very  bad"  outcome  -  Determine  the  best  outcome  of 
the  statistic  in  question  which  you  still  consider  to  be  very 
bad.  This  statistic  outcome  is  given  the  value  of  zero.  Once 
again,  use  any  strategy  for  selecting  this  outcome  which  seems 
reasonable  to  you.  If  you  want  some  aid,  the  following  strategy 
is  one  possible  technique: 
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GUIDELINES  FOR  DEFINING 
VALUE  FUNCTIONS  (Continued) 


(a)  For  each  performance,  start  at  the  "very  good"  outcome, 
which  you  recorded  In  (la),  and  identify  successively 
worse  statistic  outcomes  which  could  be  obtained  from 
that  statistic.  As  you  identify  these  worse  outcomes, 
ask  yourself  the  following  questions: 

(1)  Is  this  outcome  plausible;  could  it  really  be 
expected  to  take  place? 

(2)  Does  this  outcome  product  additional  appreciab I e 
reduction  in  system  effectiveness  as  compared  with 
the  last  previous  outcome  I  considered? 

(b)  If  the  answers  to  the  two  previous  questions  are  both  ''yes, 
you  have  not  yet  located  the  "very  bad"  outcome.  Generate 
the  next  worse  statistic  outcome.  If  the  answer  to  either 
of  these  two  questions  is  no,  the  last  previous  performance 
outcome  is  the  "very  bad"  outcome. 

(3)  Return  the  completed  Worksheets  to  sender. 
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GENERAL  INSTRUCTIONS  FOR  TRAINING  MEASURES 


HRTeS 


DESCRIPTION:  An  operational  test  (OT)  has  been  completed  recently. 

For  the  specifics  of  this  OT  see  "HPF  Diagnostic  Worksheet",  page  W8-4 
of  this  submission.  Various  operator  and  maintainer  tasks  were  measured 
during  this  OT.  One  or  more  of  these  tasks  was  evaluated  as  having  been 
performed  inadequately.  In  the  Human  Resources  Test  and  Evaluation  System 
(HRTES),  operator  and  maintainer  tasks  have  been  defined  at  a  general  level 
which  is  not  dependent  upon  the  specific  types  of  equipment  involved.  To 
avoid  confusion  with  traditional  tasks  they  have  been  named  Human  Perfor¬ 
mance  Functions  (HPF's).  The  "HPF  Diagnostic  Worksheet"  on  page  W8-4 
that  lists  the  specifics  of  the  operational  test  also  lists  the  HPF's  which 
were  performed  inadequately. 

Operational  testing  and  evaluation  personnel  have  determined  that  those 
HPF’s  that  are  listed  are  of  significant  importance  to  the  overall  evalu¬ 
ation  of  the  system  that  was  tested.  They  need  to  know  why  these  HPF’s 
were  performed  inadequately.  One  possible  reason  is  that  the  training 
of  these  HPF’s  was  in  some  way  inadequate.  To  aid  in  determining  if  this 
was  the  case,  HRTES  contains  the  following  training  measures: 


MEASURE  NAME 

MEASURE  FUNCTION 

PAGE 

W8: 

1.  Training  Time  Al location 

Adequacy  of  training  time 

9-21 

of  HPF. 

2.  Practice  Conditions  Adequacy 

Adequacy  of  practice  of  HPF. 

22-24 

3.  Compatibility  of  Training 

Adequacy  of  method  used  to 

25-39 

Methods  and  Required  Skills 

train  HPF. 

4.  Adequacy  of  personnel  who 

Adequacy  of  Operational  Test 

40-43 

trained  HPF 

Trainers. 

Each  of  these  measures  has  its  own  specific  instructions  and  worksheets. 
The  first  measure  has  an  alternative  training  time  measure. 
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GENERAL  INSTRUCTIONS  FOR  TRAINING  MEASURES 


Your  first  problem  will  be  to  decide  which  of  these  measures  to  take  of 
each  HPF.  During  the  OT,  players  and  observers  filled  in  questionnaires 
in  which  they  gave  their  opinions  of  the  difficulty  of  each  HPF  and  the 
reasons  for  significant  difficulty.  If  the  questionnaires  indicated  signi¬ 
ficant  difficulty,  they  were  reduced  and  used  to  fill  out  an  "Opinion 
Summar/  Data  Worksheet."  Scales  17-20  of  this  Worksheet  correspond  to  the 
training  measures  listed  earlier.  If  any  player  or  observer  thought  that 
performing  a  given  HPF  was  difficult  and  that  HPF  is  one  of  those  being 
diagnosed  now,  you  will  have  an  "Opinion  Summary  Data  Worksheet"  for  it 
with  this  submission.  In  this  case,  the  scale  scores  listed  may  be  helpful 
to  you  in  deciding  which  training  measures  to  take.  If  a  score  indicates 
significant  difficulty,  it  is  reasonable  to  take  the  corresponding  training 
measure  for  that  HPF.  It  is,  of  course,  possible  that  players  and  observers 
were  not  able  to  judge  whether  there  was  something  about  training  which  was 
inadequate  and  produced  inadequate  HPF  performance.  Therefore,  these  scores, 
if  they  are  available,  can  only  be  a  guide  for  you  to  use  as  you  think  best. 
However,  it  is  possible  that  players  and  observers  did  not  believe  that  an 
HPF  was  difficult.  In  this  case,  you  will  have  no  "Opinion  Summary  Data 
Worksheet"  for  that  HPF,  and  you  will  have  to  fall  back  on  your  own 
resources  to  decide  which  of  these  training  measures  to  take. 


This  submission  should  also  include  copies  of:  "Evaluation  Tree,"  "OT 
Training  Data  Collection  Worksheets,"  and  "HPF  Difficulty  Worksheets." 

The  specific  instructions  for  the  various  training  measures  will  call  for 
one  or  more  of  these  additional  documents.  The  final  document  you  should 
have  is  "Summary  Worksheet  for  Training  Diagnosis"  which  will  be  described 
in  the  following  general  procedure. 


GENERAL  PROCEDURE: 

(1)  Read  through  the  specific  instructions  for  the  training 
measures  and  familiarize  yourself  with  their  worksheets. 
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GENERAL  INSTRUCTIONS  FOR  TRAINING  MEASURES 


(2)  Examine  the  "HPF  Diagnostic  Worksheet"  to  familiarize 
yourself  with  information  about  the  OT  and  the  specific 
HPF’s  which  are  to  be  diagnosed. 

I 

(3)  Examine  the  "Opinion  Summary  Data  Worksheet"  for  each  HPF 
(if  there  is  one).  Use  their  scores  as  an  aid  to  selecting 
parallel  training  measures.  If  you  do  not  have  one  or  more 
such  worksheets,  use  your  best  judgment  for  deciding  which 
measures  to  take  of  each  HPF. 

(4)  When  you  are  finished  taking  the  measures  you  have  selected 
for  each  HPF,  make  as  many  copies  of  the  "Summary  Worksheet 
for  Training  Diagnosis  as  you  need  for  the  HPF’s  you  have 
diagnosed  (one  per  HPF). 

(5)  Fill  in  the  information  at  the  top  and  extreme  bottom  of 
each  worksheet. 

(6)  Record  the  Indices  of  Adequacy  for  each  training  measure  you 
have  taken  for  each  HPF  being  diagnosed.  This  is  to  be  done 
in  the  appropriately  labeled  boxes  on  the  worksheets. 

(7)  If  you  have  not  taken  a  specific  training  measure  for  a  given 
HPF,  and  if  you  have  an  "Opinion  Summary  Data  Worksheet"  for 
that  HPF,  use  the  appropriate  questionnaire  scale  score  as 

an  Index  of  Adequacy.  Record  this  questionnaire  based  score(s) 
in  the  appropriately  labeled  box. 


(8)  If  you  have  not  taken  a  specific  training  measure  for  a  given 
HPF,  and  if  you  do  not  have  an  "Opinion  Summary  Data  Worksheet" 
for  that  HPF,  record  an  "X"  in  the  appropriate  box. 
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(9)  Next  to  each  Index  of  Adequacy  record  an  "EXP"  or  "QUEST"  in 
the  third  column  of  the  worksheet.  "EXP"  is  recorded  next  to 
an  Index  which  was  based  on  an  expert  measure  you  have  taken. 
"QUEST"  is  recorded  next  to  an  Index  which  was  based  on  a 
questionnaire  scale  from  the  "Opinion  Summary  Data  Worksheet" 
for  that  HPF. 

(10)  Record  the  specific  training  problem(s)  which  caused  any  Index 
of  Adequacy  to  be  significantly  below  100.  This  is  to  be  done 
in  the  first  column  of  the  worksheet. 

(11)  Compute  the  mean  of  Indices  of  Adequacy  for  each  HPF  diagnosed. 
If  you  have  recorded  an  "X"  in  any  box,  leave  it  out  of  the 
computation.  Record  the  mean  in  the  Training  box  at  the  extreme 
right  of  the  worksheet. 

(12)  When  you  have  completed  the  training  measures  and  the  "Summary 
Worksheet  for  Training  Diagnosis"  return  all  materials  to 

the  sender. 


SYSTEM. 
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TRAINING  MEASURE  #1 

MEASURE  OF  TRAINING  TIME  ALLOCATION  (ALTERNATIVE  1) 


DESCRIPTION:  This  measure  compares  the  length  of  time  devoted  to 

training  the  HPF  that  is  being  diagnosed  with  the  length  of  time  devoted 
to  training  a  baseline  HPF.  To  use  this  measure  the  following  require¬ 
ments  must  be  met: 

(1)  You  must  have  access  to  a  task  list  for  a  functionally 
simi I ar  system. 

(2)  This  list  must  contain  a  similar  task  (or  HPF).  Usually  this 
will  be  the  system  being  replaced  by  the  one  which  has  been 
tested. 

(3)  You  have  no  reason  to  suspect  that  the  baseline  task  is  signifi¬ 
cantly  more  difficult  to  perform  than  the  HPF  being  diagnosed. 

(4)  You  have  access  to  data  which  includes  the  length  of  time 
devoted  to  training  this  baseline  task. 

(5)  You  have  no  reason  to  suspect  that  this  baseline  task  was 
performed  in  an  unsatisfactory  manner. 

(6)  You  have  no  reason  to  suspect  that  the  personnel  who  performed  the 
baseline  task  had  inferior  aptitudes  to  those  who  performed  the 
HPF  being  diagnosed. 

(7)  The  training  of  the  HPF  being  diagnosed  has  not  improved  in 

a  way  that  would  require  less  training  time  than  the  baseline 
task. 

If  you  have  this  information,  the  task  can  be  used  as  a  baseline  for  training 
time.  Under  these  circumstances  it  would  be  plausible  to  assume  that  the 
HPF  being  diagnosed  should  have  received  at  least  as  much  training  time  as 
the  baseline  task.  However,  this  required  information  will  probably  not 
be  available  in  the  early  tests  in  which  HRTES  is  used.  As  HRTES  continues 
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PROCEDURE: 

(1)  Determine  if  you  can  meet  al I  seven  requirements  for  the  use  of 
this  measure.  If  not,  read  alternative  #2.  If  you  can  meet  them, 
copy  "Worksheet  for  Training  Time  Allocation  Measure  (Alternative 
1)"  on  page  W8- 1 1  for  each  HPF  to  be  diagnosed. 

i 

I 

(2)  Fill  in  the  required  information  on  your  copy  of  the  worksheet. 

(3)  Divide  the  training  time  of  the  HPF  being  diagnosed  by  the 
training  time  of  the  baseline  task  (or  HPF),  and  record  it. 

If  the  resulting  quotient  is  greater  than  1.0,  record  it  as 

1.0.  A  number  larger  than  this  provides  no  additional  diagnostic 
information. 

(4)  Multiply  the  resulting  quotient  by  100,  and  record  it  on 
the  worksheet.  This  is  what  HRTES  refers  to  as  the  Index  of 
Adequacy  for  this  measure  of  training  time.  The  further  this 
Index  is  below  100,  the  greater  the  likelihood  that  insufficient 
time  was  devoted  to  training  the  HPF. 
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WORKSHEET  FOR  TRAINING  TIME 
ALLOCATION  MEASURE  (ALTERNATIVE  1) 


SIMILAR  BASELINE  SYSTEM: 


TRAINING  TIME  FOR  DIAGNOSED  HPF; _ 

TRAINING  TIME  FOR  BASELINE  HPF; _ 

DIAGNOSED  HPF/BASELINE  HPF  (1.0  MAXIMUM)  =_ 

INDEX  OF  ADEQUACY  FOR  TRAINING  TIME 
(MULTIPLY  QUOTIENT  ABOVE  BY  100)  - 


SYSTEM. 


NAME. 


.TEST _ DATE. 
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TRAINING  MEASURE  #1 

MEASURE  OF  TRAINING  TIME  ALLOCATION  (ALTERNATIVE  2) 


DESCRIPTION:  The  amount  of  time  spent  training  an  HPF  ought  to  be 

> 

related  to  its  criticality  and  difficulty.  This  measure  requires  the 
determination  of  the  criticality  and  difficulty  of  an  HPF  that  is  being 
diagnosed  and  of  five  randomly  selected  HPF’s  that  were  successfully 
performed.  Criticality  of  the  HPF’s  is  derived  from  weights  on  the 
"Evaluation  Tree"  which  has  been  included  in  this  submission.  Difficulty 
of  the  HPF’s  has  already  been  estimated  by  operational  test  players  and 
observers  and  is  recorded  on  "HPF  Difficulty  Worksheets"  which  have  been 
included  in  this  submission. 

Once  you  have  determined  the  criticality  (C)  and  difficulty  (D)  of  each 
of  the  six  HPF’s,  you  calculate  the  training  time  per  unit  of  criticality 
X  difficulty  (T/CXD)  for  each.  You  then  compare  this  statistics  for  the 
HPF  being  diagnosed  with  the  mean  of  this  statistic  for  the  five  success¬ 
fully  performed  HPF’s.  If  the  training  time  of  the  HPF  being  diagnosed 
was  insufficient,  there  should  be  a  significant  difference  between  its 
statistic  and  the  mean  statistics.  If  such  a  significant  difference  does 
not  exist,  you  cannot  assume  a  training  time  insufficiency.  In  this 
measure  a  significant  difference  is  defined  as  one  standard  deviation. 

PROCEDURE: 

(1)  Examine  the  "Evaluation  Tree"  which  is  part  of  this  submission. 
It  was  used  to  determine  the  value  of  human  and  human-machine 
performance  in  the  OT.  It  consists  of  levels  of  nodes  connected 
by  branches.  At  least  the  following  levels  should  be  present 
on  the  "Evaluation  Tree": 
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(a)  System  Level  (at  the  top  of  the  tree); 

(b)  System  Function  Level  (the  second  level); 

(c)  System  Performance  Issue  or  SPI  Level  (the  third  level); 

(d)  Human  Performance  Function  Group  or  HPF-Group  Level  (the 
fourth  level ) ; 

(e)  Human  Performance  Function  or  HPF  Level  (the  fifth  level); 

(f)  There  may  be  one  or  two  levels  below  the  fifth  level. 

They  are  not  used  in  this  measure. 


Notice  that  each  node  consists  of  a  main  rectangle  containing 
1-3  numbers  and  a  smaller  square,  which  sits  on  top  of  the 
rectangle,  and  contains  one  number.  The  number(s)  in  the  main 
rectangle  of  each  node  is  the  performance  value  and  is  not 
used  in  this  measure.  The  number  in  each  small  square  is  the 
criticality  weight  of  that  node  in  relation  to  other  related 
notes  at  that  level  of  the  "Evaluation  Tree."  These  numbers 
will  be  used  in  this  measure. 

(2)  Select  five  successfully  performed  HPF’s  from  the  HPF  Level  of 
the  tree.  You  can  tell  that  they  are  successfully  performed 
by  the  value  numbers  in  the  main  rectangle  of  each  node.  If 
there  is  only  one  number  in  each  rectangle,  any  HPF  with  a  value 
number  above  50  is  successful.  If  there  are  three  numbers  in 
each  rectangle,  any  HPF  with  a  central  and  left-hand  numbers 
above  50  are  successful.  To  the  greatest  extent  possible  select 
these  HPF’s  so  that  each  one  is  connected  by  a  branch  to  a 
different  HPF-Group  in  the  level  immediately  above.  You  now 
have  a  sample  consisting  of  one  unsuccessfully  performed  HPF 
(to  be  diagnosed)  and  five  successfully  performed  HPF's. 


SYSTEM. 


NAME. 


.TELEPHONE. 


W8-1  3 


HRTGS 


GENERAL  INSTRUCTIONS  FOR  TRAINING  MEASURES 


(3)  Compute  the  criticality  of  each  of  these  six  HPF’s.  This  is 
done  for  each  HPF  by  returning  to  the  "Evaluation  Tree"  and 
performing  the  following: 

(a)  multiply  the  criticality  weight  (in  the  small  square) 
of  each  HPF  selected  by  the  criticality  weight  of  its 
HPF-Group ; 

(b)  multiply  each  resulting  product  by  the  criticality 
weight  of  its  System  Performance  Issue; 

(c)  multiply  each  resulting  product  by  the  criticality 
weight  of  its  System  Function. 

The  final  products  are  the  criticality  weights  of  each  of  the 
six  HPF's. 

(4)  Make  a  copy  of  the  "Training  Time  Allocation  Measure  Alternative 
2  Worksheet,"  page  W8-2I  for  each  HPF  to  be  diagnosed.  Fill 

in  the  names  of  the  HPF’s  and  the  criticality  weight  for  each 
(in  column  2).  Write  small;  you  will  need  space  for  a  diffi¬ 
culty  weight  and  a  product  in  each  cell  of  this  column. 

(5)  Retrieve  the  "Opinion  Summary  Data  Worksheets"  for  the  six 
HPF's.  In  the  box  marked  "Difficulty  Score"  you  will  find 
the  difficulty  weight  of  that  HPF.  Write  these  weights  next 
to  the  criticality  weights  on  the  "Training  Time  Allocation 
Measure  Alternative  2  Worksheet." 

(6)  It  is  possible  that  you  do  not  have  "Opinin  Summary  Data  Work¬ 
sheets"  for  some  or  all  of  the  six  HPF's.  In  this  case,  retrieve 
the  "HPF  Difficulty  Worksheets"  for  each  such  HPF,  and  compute 
the  mean  difficulty  for  each. 
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(7)  It  is  possible  that  you  do  not  have  the  "HPF  Difficulty 
Worksheets"  for  some  or  all  of  the  six  HPF's.  In  this  case, 
copy  the  "HPF  Difficulty  Rating  Worksheet,"  page  W8-19, 
write  in  the  six  HPF’s,  and  rate  them  for  difficulty  on  the 
scale  given.  If  you  feel  another  individual  may  be  better  at 
this  than  you,  also  copy  the  Guidelines,  page  W8-17,  and 
have  them  use  the  worksheet  and  guidelines  to  determine  HPF 
dirf  iculty. 

(8)  One  way  or  the  other,  you  now  have  six  HPF's,  and  each  one 
has  a  criticality  and  difficulty  weight.  Multiply  these 
two  weights  for  each  HPF,  and  record  the  products  in  the 
appropriate  cells  of  the  'Training  Time  Allocation  Measure 
Alternative  2  Worksheet." 

(9)  Retrieve  the  "OT  Training  Data  Collection  Worksheets"  completed 
by  the  Trainers  during  this  operational  test.  Copy  the  training 
time  for  each  HPF  from  this  worksheet  on  to  your  'Training 

Time  Allocation  Measure  Alternative  2  Worksheet." 

(10)  Divide  each  HPF's  training  time  by  its  criticality  X  difficulty 
product,  and  record  the  resulting  quotient  on  the  worksheet. 

(11)  Compute  the  standard  deviation  of  the  last  (fourth)  column  for 
only  the  successfully  performed  HPF's.  Enter  it  in  the  standard 
deviation  box. 

Standard  Deviation  Formula; 

SD  =  J,  (X-X)^ 

N-1 
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Where : 

X  =  the  values  in  column  4  of  the  worksheet  for  the  success 
ful ly  performed  HPF’s. 

7  =  column  4  mean  of  the  successfully  performed  HPF. 

N  =  number  of  successfully  performed  HPF’s  listed  on  the 
worksheet. 


GUIDELINES  FOR  THE  HPF  DIFFICULTY 
RATING  WORKSHEET 
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The  purpose  of  this  procedure,  and  the  accompanying  worksheet,  is  to 
determine  your  estimate  of  the  performance  difficulty  of  a  series  of  tasks 
which  were  performed  during  an  operational  test. 

EXPLANATION: 

An  OT,  of  the  system  listed  on  the  attached  worksheet,  has  taken  place. 

In  this  OT,  a  series  of  generalized  tasks  were  performed.  In  HRTES,  these 
are  called  Human  Performance  Functions  of  HPF*s.  When  an  HPF  has  been 
judged  to  have  been  performed  inadequately  and  to  be  a  significant  HPF, 
the  causes  for  this  inadequate  performance  are  diagnosed.  One  possible 
cause  is  that  insufficient  training  time  was  provided,  considering  the 
HPF's  criticality  and  its  difficulty.  To  determine  this,  it  is  necessary 
to  compare  the  criticality  and  difficulty  of  performance  of  adequately  and 
inadequately  performed  HPF’s  with  the  amount  of  training  time  devoted  to 
them. 

Your  task  is  to  rate  each  listed  HPF,  or  task,  on  a  performance  difficulty 
scale  from  1-100.  This  package  consists  of;  the  guidelines  you  are 
currently  reading  and  one  or  more  "HPF  Difficulty  Rating  Worksheets." 

There  is  one  worksheet  for  each  group  of  HPF’s  containing  one  HPF  which 
was  performed  inadequately.  You  are  being  asked  to  complete  all  the  work¬ 
sheets  and  return  them  to  the  sender. 

INSTRUCTIONS: 

(11  Rate  each  of  the  HPF’s  (or  tasks)  on  the  following  scale  from 
1  — 100.  You  can  assign  any  number  from  1-100. 


HPF  extremely 
easy  to  perform 


HPF  moderately  diffi¬ 
cult  to  perform 


HPF  extremely 
difficulty  to 
perform 
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I  I  hpf  difficulty  rating  worksheet 

I  EXAMPLE  FOR  MEASURE  ALTERNATIVE  2 


SYSTEM  UNDER  TESr  Mercury  Air  Defense  Weapon  System 


TASKS  (HPF'S) 


RATING 


1.  Detect  and  Identify  target. 

SO. 

2.  Select  target  and  target  order. 

30. 

3.  Perform  misfire  procedure. 

no- 

4.  Fire  weapon. 

f.O 

5.  Perform  ground  vehicle  maneuvers  (specified). 

^o. 

6.  Fuel  ground  vehicle 

/o. 

1  aIt'ernative  : 

lb 

1  WORKSHEET 

■  ^  EXAMPLE  FOI 

R  MEASURE  A 

LTERNATIVE 

2 

r  ■ 

CRITICALITY 

TRAINING 

A 

X  DIFFICULTY 

TIME 

SUCCESSFULLY  PERFORMED  HPF’s 

(2) 

(3) 

(3)  -  (2) 

1.  Select  target  and  target  order. 

.U  y3c  = 

■9H 

2.  Perform  misfire  procedure. 

mm 

.3  y 

3.  Fire  weapon. 

.5'  /y. 

n.o 

4.  Perform  ground  vehicle  maneuvers. 

.  W 

5.  Fuel  ground  vehicle. 

.  D 

UNSUCCESSFUL  HPF 


.  Detect  and  identify  target. 

.(p 

/  /.r. 

■  oyL 

MEAN 

STANDARD  DEVIATION 

INDEX  OF  ADEQUACY 


.  ^S' 
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TRAINING  MEASURE  #2 

MEASURE  OF  THE  ADEQUACY  OF  PRACTICE  CONDITIONS 


DESCRIPTION:  The  amount  and  nature  of  practice  is  likely  to  have  a 

considerable  affect  on  the  adequacy  of  HPF  performance.  If  an  HPF  were 
performed  inadequately  under  a  given  condition  or  set  of  conditions,  and 
if  you  discovered  that  it  had  not  been  trained  under  these  conditions,  you 
might  suspect  that  this  practice  had  been  inadequate.  Further,  you  might 
suspect  that  such  an  inadequate  practice  was  a  cause  of  the  inadequate 
performance  of  the  HPF.  This  measure  is  based  on  expert  opinion  of  the 
adequacy  of  practice  which  took  place  for  the  HPF  being  diagnosed.  The 
individual  who  produces  this  expert  opinion  should  know: 

(1)  what  conditions  were  in  force  during  HPF  practice; 

(2)  the  amount  of  time  devoted  to  practicing  various  HPF's; 

(3)  the  number  of  practice  trials  for  each  HPF;  and 

(4)  how  the  practice  was  carried  out  in  terms  of  realism. 

You  will  need  to  use  the  "Evaluation  Tree"  in  this  measure. 

PROCEDURE: 

(1)  Make  one  copy  of  the  "Practice  Condition  Worksheet,"  page  W8-24, 
for  every  HPF  you  are  going  to  diagnose  using  this  measure. 

(2)  Examine  the  "Evaluation  Tree"  giving  particular  attention  to 
the  lowest  level  of  the  tree.  This  Is  the  Statistics  Level. 

At  this  level  each  HPF  has  an  individual  node  either  for  all 
the  conditions  under  which  it  was  performed,  or  under  one 
condition  that  was  varied.  Using  these  nodes,  determine  the 
conditions  under  which  each  HPF  to  be  diagnosed  was  performed 
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r(3)  For  each  HPF,  determine  how  many  conditions  are  to  be  rated, 
and  make  the  appropriate  number  of  copies  of  the  "Practice 
Condition  Worksheet." 


(4)  Each  worksheet  should  have  the  name  of  the  HPF  being  diagnosed 
and  one  condition  under  which  it  was  performed  inadequately. 

(5)  Complete  all  "Practice  Condition  Worksheets,"  by  answering 
the  questions  and  determining  the  appropriate  rating. 

(6)  If  more  than  one  condition  was  in  force  for  an  inadequately 
performed  HPF,  make  an  additional  copy  of  the  blank  "Practice 
Condition  Worksheet."  Write  "Mean"  in  the  "Condition  Box." 


(7)  Compute  the  mean  ratings  of  all  conditions  rated  for  each  HPF 
being  diagnosed.  Record  this  in  the  "Rating  Box"  of  the  Mean 
Worksheet.  This  is  the  Index  of  Adequacy  of  Practice  Conditions 
for  this  HPF.  The  further  it  is  below  100,  the  less  adequate 
the  total  practice  for  this  HPF. 

(8)  If  any  condition  received  a  rating  of  zero  because  both 
questions  1  and  2  were  answered  "NO,"  it  should  be  specifically 
noted  on  the  Mean  Worksheet.  Even  though  adequate  practice 

of  a  number  of  other  conditions  may  raise  the  final  Index,  the. 
presence  of  any  zero  could  point  to  the  actual  cause  of  Inade¬ 
quate  performance.  Therefore,  when  the  overall  Index  is 
reported,  the  total  absence  of  a  condition  in  practice  or  its 
"good  replacement"  should  also  be  reported  as  a  possible  cause. 
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HPF 


CONDITION 


1  Was  the  above  HPF  practiced 
under  the  above  condition? 

2  If  the  answer  to  number  1  was 
"NO."  was  there  a  condition  that 
was  a  good  substitute'’ 

If  the  answer  to  this  question  is 
"YES."  list  the  substitute  condition 
here - 1 

3  If  the  answer  to  either  questions  1 
or  2  was  "YES."  fill  out  the  rating 
form  below,  and  return  the 
complete  worksheet  to  sender 

If  the  answer  to  both  questions  1 
and2  was""NO."ignore  the  rating 
form  below,  and  return  it  to 
sender 


□  YES 


□  YES 


□  NO 


□  NO 


PRACTICE  CONDITION  RATING  FORM 


Pafe  the  quality  of  the  practice  of  HPF 
under  this  condition  (or  substitute 
condition). 

This  rating  should  include  your 
consideration  of  the  adequacy  of: 

(1)  Practice  time. 

(2)  Number  of  practice  trials. 

(3)  Realism  of  practice. 

(4)  Realism  of  practice  hardware/ 
software 

Your  rating  is  to  be  made  on  the 
scale,  as  indicated  here.  Any  number 
between  0  and  100  can  be  given. 


ENTER  YOUR  RATING  HERE- 
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TRAINING  MEASURE  #3 

MEASURE  OF  COMPATIBILITY  OF  TRAINING  METHODS 
AND  SKILLS  REQUIRED  FOR  THE  HPF 


DESCRIPTION:  When  someone  performs  an  HPF,  he  or  she  is  simply  exercising  I 

one  or  more  skills.  The  I  eve  I  of  the  skills  will  have  a  s ign i f icant  effect 
on  the  HPF’s  level  of  performance.  Skill  level  is  the  outcome  of  a  combina¬ 
tion  of  training  and  the  characteristics  of  the  individual.  Training  to 
enhance  skill  level  is,  itself,  a  combination  of  previous  formal  and  informal 
training  and  current  training  directed  toward  the  specific  system  being 
tested. 

All  training  methods  are  not  equally  good  at  training  all  types  of  skills. 

Each  type  of  skill  has  one  or  more  particularly  applicable  training  methods. 
The  less  appropriate  the  training  method  used,  the  higher  the  probability 
that  the  skill  will  not  be  enhanced.  If  an  HPF  being  diagnosed  required 
skills  which  were  trained  by  Inappropriate  methods,  you  would  have  reason 
to  suspect  that  these  skills  were  not  adequately  enhanced.  Further,  you 
might  suspect  that  this  was  a  cause  of  inadequate  HPF  performance.  To  aid 
you  in  understanding  this  measure,  two  complete  sets  of  examples  have  been 
included  on  pages  W8-30  through  W8-35  of  this  submission. 

PROCEDURE: 

(1)  Retrieve  the  "OT  Training  Data  Collection  Worksheets"  for 
the  HPF’s  being  diagnosed. 

(2)  Make  one  copy  of  "Training  Methods  Worksheets  #1,  #2,  and  #3" 
for  each  HPF  to  be  diagnosed  by  this  measure. 

< _ ^ 
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(3)  Fill  in  the  names  of  the  HPF’s  being  diagnosed,  etc.,  on  each 
set  of  these  worksheets.  From  this  point  on,  these  procedures 
will  apply  to  each  HPF  being  diagnosed. 


(4)  Examine  the  appropriate  "OT  Training  Data  Collection  Worksheet” 
for  the  HPF.  Copy  the  percentages  of  training  time  devoted 
to  each  training  method  from  the  above  worksheet  to  the  right- 
hand  column  of  Worksheet  #1. 


(5)  Examine  Worksheet  #2  for  the  HPF  being  diagnosed,  and  determine 
which  of  the  six  global  skill  types  listed  are  required  for 
the  performance  of  this  HPF. 


(6)  When  you  have  decided  which  skill  types  are  required,  estimate 
the  percentage  of  each  required  skill  that  must  be  present  in 
the  performance  of  this  HPF.  These  percentages  must  sum  to  100. 
Record  the  percentages  in  the  appropriate  column  of  Worksheet  #2. 


(7)  Next,  you  must  estimate  the  utility  of  each  each  training  method 
that  was  actually  used  in  the  training  of  each  required  skill 
(for  this  HPF).  Training  methods  not  actually  used  and  skills 
not  required  will  not  play  a  part  in  this  utility  rating 
procedure.  There  are  two  alternative  methods  for  making  this 
estimate  of  training  method  utility  for  skills: 
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(a)  Complete  the  "Utility  Estimate  Worksheet,"  page  W8-39, 
for  the  system  which  was  tested  in  the  OT.  This  will  be 
time  consuming  and  somewhat  difficult,  but  it  will 
represent  your  thinking  (or  the  thinking  of  some  other 
individual  who  you  get  to  complete  this  worksheet). 
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(b)  Obtain  utility  ratings  from  Table  8-1,  on  page  W8-29 
of  this  submission.  The  utility  ratings  in  this  table 
were  made  by  training  experts,  and  were  based  on  synthesis 
of  a  large  body  of  applicable  research. 

(8)  One  way  or  the  other,  you  now  have  determined  the  utility  of 
each  training  method,  actually  used,  for  training  each 
required  skill.  Enter  these  utility  ratings  in  the  appropriate 
cells  of  Worksheet  #1  for  the  HPF  being  diagnosed.  Only  enter 
the  utility  ratings  for  those  skills  actually  required  (from 
Worksheet  #2),  and  for  those  training  methods  actua I  I y  used . 

(9)  Copy  the  percentages  required  for  the  performance  of  the  skills 
(from  Worksheet  #2)  into  the  appropriate  cells  of  the  bottom 
row  of  Worksheet  #3.  Skills  which  received  no  rating  or  a 
zero  percentage  are  to  be  left  blank. 

(10)  Return  to  Worksheet  #1.  Multiply  each  number  in  the  right-hand 
column  of  this  worksheet  by  each  of  the  ratings  by  each  of 

the  ratings  in  the  row  to  which  that  first  number  belongs. 

You  are  now  multiplying  the  percentages  of  training  time 
of  each  training  method  by  the  utility  rating  of  each  skill 
required  for  the  performance  of  the  HPF. 

(11)  Record  the  products  of  the  multiplication  in  procedure  10 
in  the  appropriate  cells  of  Worksheet  #3.  You  may  find  it 
helpful  to  examine  the  various  example  worksheets  at  this  point. 

(12)  Sum  the  products  in  each  column  of  Worksheet  ^3,  and  record 
each  column's  sum  in  the  second  to  the  last  row  of  this 
worksheet  ("Sum  o^  Column"  row). 
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(13)  Compute  the  correlation  coefficient  between  the  last  two 

rows  of  Worksheet  #3.  These  are  the  "Sum  of  Column"  row  and 
the  "%  of  HPF  Involving  Skill"  row.  If  you  have  to  do  this 
computation  by  hand,  use  the  following  formula: 

Computational  Formula  for  Correlation  Coefficient: 

N  y  xY  -  ( y  X)  (yv) 


'cnIx2  -  (yx)2xNyY2  -  (yY)2] 


Where: 

r  =  correlation  coefficient. 

N  =  number  of  skills  listed  in  Worksheet  #3. 

X  =  column  sum  (second  to  last  row  in  Worksheet  #3). 

Y  =  percent  of  HPF  involving  skill  (last  row  of  Worksheet  #5). 
y  =  sum  over  the  skills  in  Worksheet  #3. 


(14)  Record  the  resulting  correlation  coefficient  in  the  appropriate 
box  of  Worksheet  #3.  This  will  be  either  a  positive  or 
negative  number  from  0  to  1.0.  The  closer  it  is  to  1.0,  the 
more  appropriate  were  the  training  methods  and  times  alloted 
to  them  in  the  training  of  the  HPF. 


(15)  Multiply  the  correlation  coefficient  by  100,  and  record  the 

resulting  product  in  the  Index  of  Adequacy  box  of  Worksheet  #3. 
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TABLE  8-1 

EXPERTS'  UTILITY  ESTIMATES 


SKILLS 


01 


TRAINING  METHODS 


— 

ORAL/WRITTEN  DRILL  PRACTICE 

1  .0 

.5 

B 

B 

B 

B 

LECTURE 

B 

B 

.3 

B 

B 

B 

INDIVIDUAL  DISCUSSION 

B 

1 .0 

.9 

.3 

- 1 

,3 

.8 

GROUP  DISCUSSION 

B 

.9 

B 

.2 

B 

.7 

READING  TEXTS 

.8 

.7 

_ 

- 1 

.3 

B 

B 

B 

EXPERT  DEMONSTRATION/VISUAL  AIDS 

.5 

B 

2 

.2 

B 

.3 

PROGRAMMED  INSTRUCTION 

.8 

.8 

.5 

B 

.3 

GAMES 

.3 

.6 

.8 

.8 

B 

SIMULATION 

,2 

.6 

1 .0 

.9 

.8 

.8 

HANDS  ON  PRACTICE— REAL  HARDWARE 

.5 

.6 

1  .0 

1  .0 

1  .0 

•  6 

SYSTEM. 

NAME 


j‘.  j- . 


_ TEST _ DATE _ 
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TRAINING  METHODS  WORKSHEET  #1 
FIRST  EXAMPLE 
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TRAINING  METHODS  WORKSHEET  #2 
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TRAINING  METHODS  WORKSHEET  #3 
FIRST  EXAMPLE 


Detect  and  identify  target 


TRAINING  METHODS 


ORAL/WRIHEN  DRILL/PRACTICE 


LECTURE 


INDIVIDUAL  DISCUSSION 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATION/VISUAL  AIDS 


PROGRAMMED  INSTRUCTION 


GAMES 


SIMULATION 


HANDS  ON  PRACTICE  -  REAL  HARDWARE 


I 


o 

o 

Z 

2 

LU 

2 

Q 

LU 

t 

o 

F— 

< 

(0 

Z 

a 

O 

< 

2 

Q 

$ 
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Q. 
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X 

m 

O 

Q 

CO 
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o 
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o 

a 

u 
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CO 

Q. 

0. 

LU 

Q 

CORRELATION 

COEFFICIENT 


INDEX  OF  , 
ADEQUACY  6 


A 


/V  ^ 


■ 

■ 

■ 

■ 

■ 

■ 

■ 

■■ 

■ 

■ 

■ 

4c 

2 

SYSTEM  ^e^cury  Air  Defense  Weapon  System _ TEST  OTI  I 

NAME _ TELEPHONE . 


6/27/e  1 


W8-32 


TRAINING  METHODS  WORKSHEET  #1 
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SECOND  EXAMPLE 


SKILLS 


Detect  and  identify  target 


TRAINING  METHODS 


ORAL/WRITTEN  DRILL/PRACTICE 


LECTURE 


INDIVIDUAL  DISCUSSION 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATION/VISUAL  AIDS 


PROGRAMMED  INSTRUCTION 


GAMES 


SIMULATION 

..5 

■ 

■ 

■ 

.«r 

.s^ 

HANDS  ON  PRACTICE  -  REAL  HARDWARE 

.5- 

■ 

■ 

■ 

RS 

^0 

SYSTEM 


Mercury  Air  Defense  Weapon  System 


NAME 


W8-33 


TELEPHONE 


TRAINING  TIME 
USING  THIS  METHOD 
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TRAINING  METHODS  WORKSHEET  #2 


SECOND  EXAMPLE 


Detect  and  idetnify  target 


Enter  the  percentage  of  each  of 
the  following  skills  required  for  the 
performance  of  HPF  above. 

The  performance  of  all  skills  must  sum 
to  100. 


SKILLS 


%  REQUIRED 
FOR  PERFORMANCE 


KNOWLEDGE 


UNDERSTANDING 


VERBAL/WRITTEN 


PSYCHOMOTOR 


_ 0_ 

I/O 


/oo 
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SECOND  EXAMPLE 


Detect  and  identify  target 


TRAINING  METHODS 


ORAL/WRIHEN  DRILL/PRACTICE 


LECTURE 


INDIVIDUAL  DISCUSSION 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATION/VISUAL  AIDS 


programmed  INSTRUCTION 


GAMES 


SIMULATION 


HANDS  ON  PRACTICE  -  REAL  HARDWARE 


CORRELATION 
COEFFICIENT  .%r 

INDEX  OF  I 
ADEQUACY  Jd 


KNOWLEDGE 

UNDERSTANDING 

VERBAL/WRIHEN 

PSYCHOMOTOR 

PERCEPTUAL 

DECISION  MAKING 

4o 

■ 

■ 

4 

4 

■ 

■■ 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

_ 

■ 

■■■ 
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■■ 
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HRT€S 


TRAINING  METHODS  WORKSHEET  #1 


%  OF  HPF 
TRAINING  TIME 
USING  THIS  METHOD 


TRAINING  METHODS  WORKSHEET  #2 

hpf  I  - 


Enter  the  percentage  of  each  of 
the  following  skills  required  for  the 
performance  of  HPF  above 

The  performance  of  all  skills  must  sum 
to  100 

SKILLS  I 


KNOWLEDGE 


UNDERSTANDING 


VERBAL/WRIHEN 


PSYCHOMOTOR 


PERCEPTION 


DECISION  MAKING 


SUM 


V _ 

SYSTEM _ TEST _ DATE 

- _ TELEPHONE _ 


NAME  __ 


W8-37 


HRTES 


TRAINING  METHODS  WORKSHEET  #3 


> 

W  HPF 

SKILLS 

TRAINING  METHODS 


ORAL/WRITTEN  DRILL/PRACTICE 


LECTURE 


INDIVIDUAL  DISCUSSION 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATION/VISUAL  AIDS 


PROGRAMMED  INSTRUCTION 


GAMES 


SIMULATION 


HANDS  ON  PRACTICE  -  REAL  HARDWARE 


CORRELATION 

COEFFICIENT 

INDEX  OF 
ADEQUACY 


SUM  OF  COLUMN 
%  OF  HPF  INVOLVING  SKILL 


SYSTEM. 

NAME- 


.TEST _ 

.TELEPHONE 


DECISION  MAKING 


HRTES 


UTILITY  ESTIMATE  WORKSHEET 


Estimate  the  utility  of  each  listed 
Training  Method  in  the  matrix  below 
for  the  training  of  each  skill,  accord¬ 
ing  to  the  current  technology.  Your 
Utility  ratings  should  fall  between  0 
and  1  0.  Zero  means  that  this  method 
has  absolutely  no  utility  for  training  this 
skill.  1.0  means  that  this  method  is  the 
best  possible  for  training  this  skill.  The 
Utility  ratings  do  not  have  to  sum  to  1.0 
for  a  given  skill. 

Return  to  sender  upon 
completion. 


TRAINING  METHODS 


ORAL/WRIHEN  DRILL  PRACTICE 


LECTURE 


INDIVIDUAL  DISCUSSION 


GROUP  DISCUSSION 


READING  TEXTS 


EXPERT  DEMONSTRATION/VISUAL  AIDS 


PROGRAMMED  INSTRUCTION 


GAMES 


SIMULATION 


HANDS  ON  PRACTICE  -  REAL  HARDWARE 


UNDERSTANDING 


HRTeS 


TRAINING  MEASURE  #4 

MEASURE  OF  THE  ADEQUACY  OF  OPERATIONAL  TEST  TRAINERS 


DESCRIPTION:  One  of  the  major  variables  of  training  which  can  produce 

sub-criterion  performance  of  a  Human  Performance  Function  (HPF)  is  inade¬ 
quate  trainer  functioning.  Trainers’  styles  vary  considerably.  This 
variation  makes  it  difficult  to  take  meaningful  measures  of  trainer 
functioning  by  observation.  Two  other  alternatives  remain: 

(1)  measuring  attitudes  toward  trainer  performance  (carried 
out  in  HRTES  questionnaires);  and 

(2)  measuring  and  evaluating  trainer  background  experiences. 

This  latter  measure  is  based  on  the  supposition  that  the  level  of  a  trainer's 
bakcground  will  have  a  significant  effect  on  ability  to  effectively  train 
an  HPF. 


In  this  measure,  you  develop  a  list  of  background  experiences  which  are 
desirable  for  training  an  HPF  which  is  being  diagnosed.  You,  or  some  other 
training  expert  you  select,  rates  each  of  these  background  experiences  on 
a  utility  scale.  You  also  determine,  or  obtain,  estimates  of  the  minimum 
amount  of  time  required  for  each  of  these  background  experiences.  You 
then  determine  which  of  these  background  experiences  the  appropriate 
trainer(s)  had  and  the  amount  of  time  for  each  one.  Finally,  you  compare 
actual  trainer  experiences  with  those  which  were  selected  as  being 
desirable  for  training  the  given  HPF. 


PROCEDURE: 


(1) 


Make 

page 

The 


one  copy  of  the  "Index  of  Trainer  Adequacy 
W8-43,  for  each  HPF  to  be  diagnosed  using 
rest  of  these  procedures  apply  to  only  one 


Worksheet, " 
this  measure. 
HPF  at  a  time. 


HRT6S 


However,  much  of  the  information  developed  for  the  first  HPF 
should  be  applicable  to  all  the  others  being  diagnosed. 

(2)  In  the  first  column  of  the  worksheet,  list  the  specific  back¬ 
ground  experiences  which  a  trainer  should  have  to  effectively 
train  the  HPF  being  diagnosed.  This  should  include:  experiences 
as  a  trainer,  if  any;  specific  operational  or  maintenance 
experiences,  if  any;  specialties  held,  if  any;  and  educational 
experiences,  if  any. 

(7)  For  each  background  experience  listed  estimate  the  minimal 

amount  of  time  required  in  the  second  column  of  the  worksheet. 
These  amounts  of  time  should  be  listed  as  months. 

(4)  Rate  each  listed  background  activity  on  the  following  scale. 
Select  any  number  from  0-100.  It  is  understood  that  since 
you  have  already  stated  that  these  activities  are  required, 
you  will  never  rate  any  of  them  "0."  The  lower  anchors  of 
this  scale  are  presented  to  make  clearer  the  meaning  of  the 
scale.  When  you  have  rated  a  given  background  activity  record 
the  rating  in  the  third  column  of  the  worksheet. 


No  utility  for 
training  this  HPF 


MODERATE 

50 


Moderately  useful  for 
training  this  HPF 


ABSOLUTELY 

REQUIRED 

100 


Absolutely  required 
for  tra i n i ng  this 
HPF 


(5)  Multiply  the  time  and  utility  weight  of  each  background 
experience.  Record  the  resulting  prdouct  in  the  fourth  column 
of  the  worksheet. 

(6)  Add  the  products  in  the  fourth  column  of  the  worksheet,  and 
record  the  resulting  sum  in  the  Sum  (A)  box  of  the  worksheet. 


V 

i  * 

SYSTEM . 

« 

■v'-- 

NAME- 

.TEST _ DATE. 

-TELEPHONE _ 


W8-41 
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(7)  Determine  if  the  trainer(s)  of  the  HPF  being  diagnosed 

had  each  of  these  background  experiences  (or  others  which 
were  functionally  identical).  If  the  trainer(s)  did  not 
have  a  given  experience,  record  a  zero.  If  a  trainer 
did  have  an  experience,  determine  how  many  months  were 
devoted  to  it.  If  more  than  one  trainer  trained  the 
personnel,  who  performed  this  HPF  inadequately,  compute 
the  means  of  the  months  of  the  experiences.  If  the  actual 
trainer  time  for  any  given  background  experience  is 
greater  than  the  minimum  acceptable  time  (which  has  been 
recorded),  record  the  minimum  acceptable  time.  Do  not 
record  the  actual  trainer  time.  Without  this  truncation 
it  would  be  possible  for  large  amounts  of  experience  in  one 
area  to  entirely  obscure  a  total  absence  in  another.  If 
the  actual  trainer  time  is  less  than  the  minimum  acceptable 
time,  record  it  directiy. 


(8)  Multiply  the  utility  weight  of  each  background  experience 
(from  the  second  column)  by  the  actual  trainer  time  of  that 
experience  (from  the  fifth  column).  Record  the  resulting 
products  in  the  sixth  column  of  the  worksheet. 


(9)  Add  these  products,  and  record  the  resulting  sum  in  the 
Sum  (B)  box  on  the  worksheet. 


(10)  Divide  Sum  (B)  by  Sum  (A).  Multiply  the  resulting  quotient 
by  100.  Record  the  resulting  product  in  the  Index  box  of 
the  worksheet.  This  is  the  Index  of  Adequacy  of  Trainer 
Background  for  the  HPF.  If  the  trainer's  background  is 
entirely  appropriate  for  training  this  HPF,  the  Index  will 
be  approximately  100.  The  less  adequate  the  background, 
the  further  the  Index  will  be  below  100. 


SYSTEM 


NAME- 


W8-42 


-TELEPHONE- 
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INDEX  OF  TRAINER  ADEQUACY  WORKSHEET 
HPF:  _ _ 
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SUMMARY  WORKSHEET  FOR  TRAINING  DIAGNOSIS 


HRTGS 


4  OT  TRAINER 
ADEQUACY 


lJ|J3TnC«CI  GENERAL  INSTRUCTIONS  FOR  HUMAN  FACTORS 
nr%  I  Vm mmM  ENGINEERING  (HFE)  MEASURES 

-  - 

DESCRIPTION:  An  operational  test  (OT)  has  been  completed  recently.  I 

For  the  specifics  of  this  OT,  see  "HPF  Diagnostic  Worksheet,"  page  W8-4 
of  this  submission.  Various  operator  and  maintainer  tasks  were  measured 
during  this  OT.  One  or  more  of  these  tasks  was  evaluated  as  having  been 
performed  inadequately.  In  the  Human  Resources  Test  and  Evaluation  System 
(HRTES)  operator  and  maintainer  tasks  have  been  defined  at  a  general  level 
which  is  not  aependent  upon  the  specific  types  of  equipment  involved.  To 
avoid  confusion  with  traditional  tasks  they  have  been  named  Human  Performance 
Functions  (HPF’s).  The  "HPF  Diagnostic  Worksheet"  on  page  W8-4  that  lists 
the  specifics  of  the  operational  test  also  lists  the  HPF’s  which  were 
performed  inadequately. 

Operational  testing  and  evaluation  personnel  have  determined  that  those 
HPF’s  that  are  listed  are  of  significant  importance  to  the  overall  evalu¬ 
ation  of  the  system  that  was  tested.  They  need  to  know  why  these  HPF’s 
were  performed  inadequately.  One  possible  reason  is  that  the  human-machine 
interface,  or  the  actual  procedure  itself,  was  inadequate  in  some  way,  and 
this  inadequacy  was  a  cause  of  the  level  of  performance.  To  aid  in  deter¬ 
mining  if  this  was  the  case,  HRTES  contains  the  following  HFE  measures: 


MEASURE  NAME 

MEASURE  FUNCTION 

PAGE 

W8: 

1.  Understandab i 1 i ty  of  Procedure 

Adequacy  of  complexity  of  HPF 

procedure. 

54-57 

2.  Difficulty  of  Decisions  ; 

1 

Difficulty  of  making  decisions 

required  by  HPF. 

58-66 

3.  Display  Information  Adequacy 

and  Timel iness 

Presentation  of  required  infor¬ 
mation  on  time  by  displays  used 

in  HPF. 

67-71 

4.  Display  Readability/ 

Hearab i 1 i ty 

Adequacy  of  presentation  charac¬ 
teristics  of  information 

required  ir  HPF. 

72-77 

k _ ^ 

SYSTEM _ test _ DATE _ PAGE 

NAME _ TELEPHONE - 


W8-45 


MEASURE  NAME 


MEASURE  FUNCTION 


5.  Display  Information  Under- 

standabi 1 ity 

Understandab i 1 i ty  of  information 

required  for  HPF  as  presented  by 

displays. 

- - 

78-82 

6.  Control  Accessibility 

Accessibility  of  controls  or 
other  equipment  manipulated  in 

HPF  performance. 

83-86 

7.  Control  Static  Charac¬ 
teristics 

Adequacy  of  control  characteristics 

other  than  those  for  actual  manipu¬ 
lation  or  accessibility  (includes 

any  equipment  to  be  manipulated  in 

HPF  performance. 

87-91 

8,  Control  Dynamic 

Characteristics 

Adequacy  of  control  manipulation 

characteristics  (includes  any 

equipment  to  be  manipulated  in  HPF 

performance 

92-96 

9.  Workstation  Dimensional 

Characteristics 

Adequacy  of  physical  dimensions  of 
the  workstation  for  HPF  performance 

(does  not  include  seat  dimensions 

or  dimensions  involved  in  control 

access! bi 1 ity. 

97 

10.  Workstation  Seating 

Character! sties 

Adequacy  of  seating  dimensions  and 

other  related  characteristics  for 

HPF  performance. 

98 

11.  Workstation/Environment 

Visual  Characteristics 

Adequacy  of  workstation  charac¬ 
teristics  which  affect  vision  both 

within  and  outside  the  workstation 

for  HPF  performance. 

99 

12.  Workstation/Environment 

Sound  Characteristics 

Adequacy  of  workstation  and  environ¬ 
mental  sound  characteristics  which 

affect  HPF  performance. 

ICO 

i 
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MEASURE  NAME 

MEASURE  FUNCTION 

PAGE 

W8: 

13.  Workstation  Motion 

Characteristics 

j 

Adequacy  of  workstation  motion 

characteristics  which  affect 

HPF  performance. 

101 

14.  Workstation/Environment 

Ventilation  Characteristics 

Adequacy  of  workstation/environ¬ 
ment  ventilation  characteristics 

which  affect  HPF  performance. 

102 

15.  Workstation/Envi ronment 

Evaluation  of  safety  hazards  which 

103 

Safety  Characteristics 

[  might  affect  HPF  performance. 

From 

16.  Workload 

Adequacy  of  workload  during  the 
performance  of  the  HPF  being 
diagnosed. 

Quest ic 
na i res 

This  section  includes  a  set  of  "General  Procedures"  which  applies  to  al I 
of  the  listed  HFE  measures.  Each  of  the  first  8  measures  has  its  own 
specific  procedures  which  accompany  the  measure  worksheet.  Measures  9-15 
have  a  common  set  of  procedures.  These  procedures  apply  to  each  of  these 
measures.  They  are  listed  in  this  section  and  are  entitled  "Common 
Procedures  for  Measures  9-15."  Measure  16,  "Workload"  is  entirely  based 
on  the  "Workload  Scale"  found  in  the  "Opinion  Summary  Data  Worksheet"  for 
the  HPF  being  diagnosed. 


Your  first  problem  will  be  to  decide  which  of  these  measures  to  take  of  each 
HPF.  During  the  OT,  players  and  observers  filled  in  questionnaires  in  which 
they  gave  their  opinions  of  the  difficulty  of  each  HPF  and  the  reasons  for 
significant  difficulty.  If  the  questionnaires  indicated  significant  diffi¬ 
culty,  they  were  reduced  and  used  to  fill  out  an  "Opinion  Summary  Data 
Worksheet."  Scales  1-16,  and  scale  21  of  this  worksheet  correspond  to  the 
HFE  measures  listed  earlier.  If  any  player  or  observer  thought  that 
performing  a  given  HPF  was  difficult  and  that  HPF  is  one  of  those  being 
diagnosed  now,  you  will  have  an  "Opinion  Summary  Data  Worksheet"  for  it 


SYSTEM . 
NAME_ 


.TEST. 


DATE. 


.PAGE 


W8-47 


.TELEPHONE. 


with  this  submission.  In  this  case,  the  scale  scores  listed  may  be  helpful 
to  you  in  deciding  which  HFE  measures  to  take.  If  a  score  indicates 
significant  difficulty  (50  or  below)  it  is  reasonable  to  take  the  corres¬ 
ponding  HFE  measure  for  that  HPF.  It  is,  of  course,  possible  that  players 
and  observers  were  not  able  to  judge  whether  there  was  something  which  was 
inadequate  and  produced  inadequate  HPF  performance.  Therefore,  these  scores 
if  they  are  available,  can  only  be  a  guide  for  you  to  use  as  you  think  best. 
However,  it  is  possible  that  the  players  and  observers  did  not  believe  that 
an  HPF  was  difficult.  In  these  case,  you  will  have  no  "Opinion  Summary 
Data  Worksheet"  for  that  HPF,  and  you  will  have  to  fall  back  on  your  own 
resources  to  decide  which  of  these  measures  to  take. 

In  addition  to  the  "Opinion  Summary  Data  Worksheets,"  this  submission  should 
include  a  copy  of  the  "Summary  Worksheet  for  HFE  Diagnosis"  that  will  be 
described  in  the  following  general  procedure,  and  a  copy  of  the  previously 
described  "HPF  Diagnostic  Worksheet." 

GENERAL  PROCEDURE  (APPLIES  TO  ALL  HFE  MEASURES): 

(1)  Read  through  the  specific  instructions  for  the  HFE  measures, 
and  familiarize  yourself  with  their  worksheets. 

(2)  Examine  the  "HPF  Diagnostic  Worksheet"  to  familiarize  yourself 
with  information  about  the  OT  and  the  specific  HPF’s  that  are 
to  be  diagnosed. 

(3)  Examine  the  "Opinion  Summary  Data  Worksheet"  for  each  HPF  (if 
there  is  one).  Use  their  scores  as  an  aid  to  selecting 
parallel  HFE  measures.  If  you  do  not  have  one  or  more  such 
worksheets,  use  your  best  judgment  for  deciding  which  measures 
to  take  of  each  HPF. 


HRTeS 


(4)  When  you  have  finished  taking  the  measures  you  have  selected 
for  each  HPF,  make  as  many  copies  of  the  "Summary  Worksheet 
for  the  HFE  Diagnosis"  as  you  need  for  the  HPF's  you  have 
diagnosed  (one  per  HPF). 


(5)  Fill  in  the  information  at  the  top  and  extreme  bottom  of 
each  worksheet. 


(6)  Record  the  specific  HFE  indices  of  adequacy  for  the  measures 
you  have  taken  for  each  HPF  being  diagnosed.  This  is  to  be 
done  in  the  appropriately  labeled  boxes  on  the  worksheets. 


(7)  If  you  have  not  taken  a  specific  HFE  measure  for  a  given  HPF, 
and  if  you  have  an  "Opinion  Summary  Data  Worksheet"  for  that 
HPF,  use  the  appropriate  questionnaire  scale  score  as  an 
Index  of  Adequacy.  In  the  case  of  "Workload,"  this  will 
always  be  the  case.  Record  the  questionnaire  based  score(s) 
in  the  appropriate  labeled  box. 


(8)  If  you  have  not  taken  a  specific  HFE  measure  for  a  given 

HPF,  and  if  you  do  not  have  an  "Opinion  Summary  Data  Worksheet" 
for  that  HPF,  record  an  "X"  in  the  appropriate  box. 


(9)  Next  to  each  specific  index  of  adequacy  record  an  "EXP"  or 
"QUEST"  in  the  third  column  of  the  worksheet.  "EX"  is 
recorded  next  to  an  Index  which  was  based  on  an  expert  measure 
you  have  taken.  "QUEST"  is  recorded  next  to  an  index  which 
was  based  on  a  questionnaire  scale  from  the  "Opinion  Summary 
Data  Worksheet"  for  that  HPF. 


(10)  Record  the  specific  HFE  problem(s)  which  caused  any  specific 
index  of  adequacy  to  be  significantly  below  100.  This  is  to 
be  done  in  the  first  column  of  the  worksheet.  If  necessary. 
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append  an  addition  sheet  for  this  explanatory  purpose,  and 
reference  it  in  the  first  column. 

(11)  Compute  the  means  of  the  specific  Indices  of  adequacy  according 
to  the  branching  structure  on  the  worksheet.  Means  are  to  be 
computed  of  Indices:  1  +2+3+4+5+6+7+8+9+  10+ 
11+12+13+14+15.  Measure  16,  Workload,  is  simply 
transfered  to  the  next  box.  If  you  have  recorded  an  "X"  in 
any  box,  leave  it  out  of  the  computation.  Record  the  resulting 
means  in  the  appropraite  boxes  for  Collective  Indices. 

(12)  If  a  I  I  of  the  specific  indices  are  absent,  for  a  given 
collective  index,  record  an  "X”  in  the  box  for  that 
col  I ect ive  i ndex. 

(13)  Compute  the  mean  of  the  collective  indices.  If  you  have 
recorded  an  "X"  in  any  collective  index  box,  leave  it  out 
of  the  computation.  Record  the  mean  in  the  Human  Factors 
Engineering  Box  at  the  extreme  right  of  the  worksheet. 

(14)  When  you  have  completed  the  HFE  measures  and  the  "Summary 
Worksheet  for  HFE  Diagnosis"  return  all  materials  to  the 
sender. 

COMMON  PROCEDURES  FOR  MEASURES  9  THROUGH  14: 

(1)  Make  sufficient  copies  of  the  Measure  Worksheet  so  that  you 
have  one  for  each  HPF  to  be  diagnosed. 

(2)  Study  the  characteristics  listed  on  the  worksheet.  If  you 
think  that  a  significant  characteristic  is  missing,  add  it 
in  the  "Other"  category. 
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(3)  Decide  If  each  characteristic  on  the  worksheet  is  relevant 
to  the  performance  of  the  HPF  being  diagnosed  In  this  system. 
If  it  might  have  a  significant  effect  on  HPF  performance  in 
this  system,  it  is  relevant.  In  this  case,  record  an  "X"  in 
the  appropriate  ceil  of  the  Relevance  Column.  If  a  charac¬ 
teristic  is  not  relevant,  record  a  "0"  in  the  cell. 

(4)  Rate  each  characteristic  that  you  have  selected  on  the 
criticality  scale  which  follows.  Select  any  rating  from 
1-100.  Record  the  ratings  in  the  appropriate  cells  of  the 
Rating  Col umn. 


LOW  CRITICALITY 

1  25 


Just  important  enough 
to  be  measured.  Criti¬ 
cality  low  for  this  HPF. 


MODERATE  CRITICALITY 

50  75 


Criticality  moderate 
for  this  HPF. 


HIGH  CRITICALITY 
100 


Crit ica I ity 
extremely  high 
for  this  HPF. 


(5)  Obtain  appropriate  measurements  of  each  characteristic  you 
have  selected.  This  may  be  done  in  the  following  ways: 


(a)  Obtaining  appropriate  measurements  from  previous 
OT's,  DT*s,  HFE  tests,  or  other  reasonably  reliable 
sources; 

(b)  Physically  taking  the  necessary  measurements  from 
the  actual  system; 

(c)  Taking  some  version  of  the  necessary  measurements  from 
system  documentation. 


(6)  Compare  each  measurement  with  the  standard  or  specification 
which  applies  to  it.  This  may  be  done  in  the  following  ways: 


HRT€5 

— 

(a)  Comparison  with  reasonably  valid  specifications  such 
as  those  found  in  MIL  STD- 1472,  HEDGE,  and  HFTEMAN— 
this  is,  of  course,  preferable. 

(b)  Evaluation  based  on  expert  judgment — in  the  absence 
of  an  applicable  standard,  your  judgment  may  be 
substituted. 

(7)  If  a  given  characteristic  meets  its  standard,  record  a 
"1"  in  the  appropriate  cell  of  the  0/1  column.  If  it 
does  not  meet  its  standard  (or  your  judgment),  record  a 
"0"  in  this  cel  I . 

(8)  Record  the  source  of  each  comparison  in  the  appropriate 
cell  of  the  Source  Column.  This  should  be  information 

as  to  the  source  of  the  measurement  itself  and  the  standard. 
If  there  is  insufficient  space  to  record  all  the  required 
source  information,  append  a  page  and  use  the  space  to  refer 
to  i  t . 

(9)  Multiply  the  0  or  1  for  each  characteristic  by  the  1-100 
rating  of  its  criticality.  Record  the  resulting  products 
in  the  appropriate  cells  of  the  Product  Column. 

(10)  Add  all  the  products,  and  record  the  resulting  sum  in 
the  Product  Sum  Cell. 

(11)  Add  all  the  0  or  1  ratings  in  the  Rating  Column,  and  record 
the  resulting  sum  in  the  Rating  Sum  Cel  I . 

(12)  Divide  the  Product  Sum  ^  the  Rating  Sum,  and  multiply  the 
resulting  quotient  by  100.  Record  the  resulting  product 
in  the  Index  Cell.  This  is  the  Index  of  Adequacy  for  this 
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measure.  If  the  measures  of  the  significant  characteristics 
just  met  their  standards,  the  Index  would  be  approximately 
100.  The  less  adequate  the  characteristics  that  are  measured 
considering  their  criticality,  the  farther  below  100  will 
be  the  Index. 
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HFE  MEASURE  #1 
UNDERSTANDABILITY  OF  PROCEDURE 


DESCRIPTION:  When  an  HPF  has  been  performed  inadequately,  one  possible 

cause  is  that  its  procedure  was  too  difficult  for  the  performers.  This 
measure  requires  an  analysis  of  the  performance  of  the  HPF  being  diagnosed 
into  its  component  performance  elements.  These  elements  are  then  used  as 
the  basis  for  a  multi-attribute  rating  process.  Therefore,  to  use  this 
measure,  one  must  either  fully  understand  the  procedure  for  this  HPF,  or 
have  access  to  an  individual  who  understands  it  and  will  decompose  the 
procedure  into  its  elements  for  you. 

PROCEDURE: 

(1)  Make  sufficient  copies  of  "Procedure  UnderstandabI I ity 
Worksheets  #1  and  #2"  for  the  HPF's  to  be  diagnosed  (pages 
W8-56  and  W8-57. 

(2)  Fill  in  the  background  data  on  each  worksheet.  The  rest  of 
these  procedures  will  apply  to  only  one  HPF. 

(3)  On  Worksheet  #1,  list  the  elements  required  to  perform  the 
HPF  being  diagnosed.  These  elements  should  be  analyzed  to 
the  smallest  level  of  detail  possible.  This  analysis  should 
be  made  for  the  specific  system  tested  In  the  OT. 

(4)  On  Worksheet  #1,  specify  the  sequence  of  performance  of  the 
listed  elements.  This  is  done  by  recording  sequence  numbers 
in  the  appropriate  Performance  Sequence  Cells  of  the  worksheet 
(first  element  performed  is  numbered  i,  etc.).  In  general, 
these  sequence  numbers  should  be  recorded  in  the  left-hand 
column  under  the  heading,  "Performance  Sequence. "  However, 
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sometimes  an  element  may  be  performed  more  than  once  in  an 
HPF  procedure.  In  this  case,  record  the  second  sequence  number 
for  that  element  in  the  next  column,  the  third  number  for  that 
element  in  the  third  column,  etc.  If  two  elements  are  performed 
at  the  same  time,  give  them  the  same  sequence  number. 

(5)  When  you  have  finished  recording  the  elements  and  their  sequence 
numbers,  add  the  total  number  of  elements.  Record  the  sum 

in  the  box  at  the  bottom  of  the  worksheet. 

(6)  On  Worksheet  #2,  rate  the  HPF  procedure  which  you  have  analyzed. 
Use  all  three  scales,  and  assign  any  rating  from  0-100  to 
each.  Record  the  three  ratings  in  the  appropriate  boxes  of 
this  worksheet.  Two  of  the  three  scales  are  based  on  the 
material  you  developed  in  Worksheet  #1. 

(7)  Compute  the  mean  of  the  three  rating  scales,  and  record  it 
in  the  Mean  Box  at  the  top  of  Worksheet  #2. 
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PROCEDURE  UNDERSTANDABILITY 
WORKSHEET  #2 


Assign  a  rating  of  0-100  to  each  of  the  following  attributes  of  under¬ 
standing  of  procedures  for  the  HPF  listed  above. 

MEAN  RATING  ^ 

(INDEX)  - 


1.  What  is  the  degree  of  similarity  between  the  procedure  for  performing 
this  HPF  and  the  procedure  for  a  similar  HPF  which  the  OT  participants 
have  actually  performed,  previously?  I  I 


0 _ 25 _ 50 _ 75 _ 100 

Totally  unrelated  Moderately  related  to  100?  identical  to 
to  any  previous  a  previously  performed  previous  procedure 
procedure.  procedure. 


2.  What  Is  the  effect  of  this  HPF’s  number  of  elements  (shown  on  the 


proceding  worksheet)  on  the  difficulty  of  understanding  the  procedure? 


0  25  50  75  ' - '  100 


Number  so  large,  it 
makes  understanding 
impossibly  difficult. 


Number  of  elements 
produces  moderate 
difficulty  in  under¬ 
standing  procedure. 


This  number  of 
elements  would  not 
increase  the  under¬ 
standing  difficulty 
at  a  I  I  . 


3.  What  is  the  effect  of  the  complexity  of  the  sequence  of  performance 
of  the  HPF  elements  (shown  on  the  preceding  worksheet)  on  the  diffi¬ 


culty  of  understanding  the  performance? 


0  25  50  _ 75 _ 100 


Sequence  so  complex, 
understanding  of  perfor¬ 
mance  is  impossible. 


Sequence  complexity 
produces  moderate 
difficulty  in  under¬ 
standing  procedure 


Sequence  so  simple 
and  I i near  wou I d 
not  increase  under^ 
standing  difficult 
at  all. 
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HFE  MEASURE  #2 


DIFFICULTY  OF  DECISIONS 


DESCRIPTION:  One  possible  cause  of  inadequate  HPF  performance  is  that 

the  required  decisions  were  too  difficult  for  the  performers.  This  measure 
requires  an  analysis  of  the  HPF  being  diagnosed  into  its  decisions  and  those 
decisions  into  their  alternative  responses.  These  decisions  and  responses 
are  then  used  as  a  basis  for  a  multi-attribute  rating  process.  Therefore, 
to  use  this  measure  one  must  either  fully  understnad  the  HPF  in  the  system 
that  was  tested,  or  have  access  to  an  individual  who  does. 


PROCEDURE: 


(1)  Make  sufficient  copies  of  "Decision  Difficulty  Rating 

Worksheet  and  #2"  for  the  HPF*s  to  be  diagnosed  (pages 
W8-ei  and  W8-66 


(2)  Fill  in  the  background  data  on  each  worksheet.  The  rest  of 
these  procedures  will  apply  to  only  one  HPF. 


(3)  On  Worksheet  #1,  list  all  the  decisions  which  must  be  made 
to  perform  this  HPF  in  this  system.  Then  list  them  on 
Worksheet  #2. 


(4)  On  Worksheet  #1,  for  each  listed  decision,  record  the 
realistic  alternative  responses.  These  are  the  actual 
outcomes  among  which  the  individual  making  the  decision 


must  choose. 


(5)  On  Worksheet  ^1,  for  each  decision,  add  the  total  number  of 
alternative  responses,  and  record  the  resulting  sums. 
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(6)  On  Worksheet  #1,  add  the  total  number  of  decisions  required 
for  the  performance  of  the  HPF,  and  record  the  resulting  sum 
in  the  box  at  the  top  of  the  first  page  of  the  worksheet. 

(7)  On  Worksheet  #2,  apply  "Rating  Scales  for  Decision  Difficulty 
Worksheet  #2"  to  the  material  you  have  developed  on  Worksheet 
#1.  The  first  scale  of  the  Rating  Scales  applies  to  all 
decisions  required  for  the  HPF  taken  together.  Record  your 
rating  for  this  first  scale  in  the  Rating  for  Scale  One  box 
at  the  top  of  Worksheet  #2.  All  other  rating  scales  apply  to 
each  decision  listed  on  Worksheet  #2.  So,  apply  each  rating 
scale  (from  2-4)  to  each  listed  decision,  and  record  the 
resulting  ratings  in  the  appropriate  cells  of  Worksheet  #2. 

(8)  On  Worksheet  #2,  for  each  decision,  add  the  ratings  of  all 
scales  p I  us  the  rating  of  scale  one  (scale  one  rating  is 
located  In  the  box  at  the  top  of  the  worksheet).  Record  the 
resulitng  sums  in  the  appropraite  cells  of  the  left-hand 
column  of  the  worksheet. 

(9)  Add  all  the  sums  in  the  left-hand  column  of  Worksheet  #2. 
Divide  this  grand  sum  by  the  total  number  of  decisions 
(from  Worksheet  #1)  multipled  by  six  (the  number  of  rating 
scales).  Record  this  mean  rating  in  the  appropriate  box  at 
the  bottom  of  Worksheet  #2. 


(10)  For  clarity,  the  rating  scales  of  this  measure  were  designed 
so  that  the  higher  the  rating  the  greater  the  difficulty. 

To  make  the  Index  of  Adequacy  comparable  to  other  Indices, 
this  direction  must  be  reversed.  Therefore,  the  final  step 
in  this  computation  is  to  subtract  the  product  computed  in 
step  9  from  100.  Record  the  resulting  number  in  the  Index 
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Box  on  the  bottom  of  Worksheet  #2.  If  this  Index  of 
Adequacy  is  approimately  100,  decision  difficulty  for  the 
HPF  is  entirely  adequate.  The  farther  below  100  In  this 
Index,  the  less  adequate  is  decision  difficulty. 


HPF: 


First,  list  all  the  types  of  decisions  which  must  be  made  to  perform  the 
HPF  above  in  this  system.  Second,  for  each  type  of  decision  listed, 
specify  alternative  responses  among  which  each  decision  selects.  Third, 
record  the  total  number  of  decisions  required  for  this  HPF  and  the  number 
of  alternative  responses  for  each  decision.  Fourth,  complete  the  rating 
scales,  on  the  attached  worksheet,  which  apply  to  the  information  you 
have  just  developed,  if  there  is  insufficient  space  on  this  worksheet, 
photocopy  it. 


TOTAL  NUMBER  OF  DECISIONS  REQUIRED  FOR  HPF: 


DECISIONS  REQUIRED  FOR  HPF  ALTERNATIVE  RESPONSES  TO  EACH  DECISION 


SUM  = 


SUM  = 


SUM  = 


UE3^nCIC^  DECISION  DIFFICULTY  RATING 
11  r\  I  WORKSHEET  #1  (CONTINUED) 

r - 


DECISIONS  REQUIRED  FOR  HPF 


ALTERNATIVE  RESPONSES  TO  EACH  DECISION 


HRTeS 


DECISION  DIFFICULTY  RATING 
WORKSHEET  (CONTINUED) 


DECISIONS  REQUIRED  FOR  HPF 


ALTERNATIVE  RESPONSES  TO  EACH  DECISION 


I  RATING  SCALES  FOR  DECISION 

I  DIFFICULTY  WORKSHEET  #2 


HPF: 


Rating  scale  number  one  applies  to  all  decisions  required  for  this  HPF, 
taken  together.  All  other  rating  scales  apply  to  each  required  decision, 
independently.  Recrod  your  rating  from  the  rating  scale  number  one  in 
the  box  at  the  top  of  Worksheet  #2,  and  all  other  ratings  in  the  appro¬ 
priate  cells  of  the  worksheet. 

1.  How  difficult  would  it  be  to  make  the  number  of  decisions  required 
for  the  performance  of  this  HPF  in  this  system? 

0 _ 25 _ 50 _ 75 _ ^ 

No  difficulty  Moderately  So  difficult 

at  all.  difficult.  that  it  could 

not  be  done. 

2.  How  significant  would  this  decision  be  when  made  as  part  of  the  HPF 
in  this  system? 


25 


50 


75 


100 


No  significance 
at  all. 


Moderately  Extremely  signi- 
significant.  ficant.  Affects 

mission  success, 
system  surviva¬ 
bility. 


3.  Under  real istic  conditions,  how  much  time  will  be  I ikely  to  be 
available  to  make  this  decision  and  still  permit  the  HPF  to  be 
performed  successfully? 


25 


50 


75 


100 


Time  is  not  an  issue 
at  all.  Any  amount 
can  be  taken. 


Moderate  amount  of 
time  can  be  taken 
and  the  HPF  can  be 
performed  successfully. 


Only  a  very 
smal I  amount  of 
time  can  betaken. 


4.  To  what  extent  is  this  decision  i rrevers i b le  if  made  during  the 
performance  of  this  HPF  in  this  system? 


Not  an  issue. 

Dec i s i on  may  be 
reversed  as  many 
times  as  desired. 


Sma 1 1  number  of 
reversals  possible. 


I rrevers i b i I i ty 
total.  Decision 
must  stand  as  made. 


5.  How  difficult  would  it  be  to  make  this  decision  considering  the 
number  of  alternative  responses  possible? 


No  difficulty 
at  all. 


Moderately 

difficult. 


So  difficult  that 
this  decision 
cou I d  not  be  made 
successful  I y . 


6.  How  similar  are  the  alternative  responses  which  must  be  considered 


in  making  this  decision? 


No  similarity  at 
all.  Responses 
are  completely 
different  from 
each  other. 


Moderately 
simi lar. 


Responses  are 
extremely  similar. 
Hard  to  separate. 


SYSTEM. 


NAME- 


W8-65 


-TELEPHONE. 


.-Ji  -  j*  - « -  «*•  w**  -**•  i.'-, 


HRT6S 


DECISION  DIFFICULTY  WORKSHEET  #2 


GRAND  SUM 

TOTAL  #  OF  DECISIONS  X  6 


GRAND  SUM: 


INDEX  OF  ADEQUACY 
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HFE  MEASURE  #3 

ADEQUACY  AND  TIMELINESS  OF  DISPLAY  INFORMATION 


DESCRIPTION:  One  possible  cause  of  inadequate  HPF  performance  is  that 

required  information  was  not  available  in  time  for  its  use.  This  measure 
requires  the  identification  of  the  information  required  for  the  performance 
of  the  HPF  being  diagnosed.  In  addition,  it  requires  the  judgment  of 
whether  each  piece  of  required  Information  is  time  sensitive.  If  a  piece 
of  information  is  so  judged,  it  then  requires  the  judgement  of  the  maximum 
length  of  time  that  can  occur  before  the  useful  appearance  of  that 
information.  Therefore,  to  use  this  measure,  one  must  thoroughly  under¬ 
stand  the  information  requirements  for  the  HPF,  have  access  to  detailed 
documentation  about  these  requirements,  or  have  access  to  an  individual 
who  thoroughly  understands  these  requirements. 

PROCEDURE; 


/ 


(1)  Make  sufficient  copies  of  "Display  Information  Adequacy  and 
Timeliness  Worksheet"  (p.  W8-71 )  for  the  HPF’s  to  be  diagnosed. 

(2)  Fill  in  the  background  data  on  each  worksheet.  The  rest 

of  the  procedures  will  apply  to  only  one  HPF  to  be  diagnosed. 

(3)  Record  all  the  information  which  is  absolutely  required  for 
the  successful  performance  of  the  HPF  being  diagnosed.  This 
includes  information  which  would  be  produced  visually  or 
auditorily.  It  does  not  apply  to  one  display  only.  It  applies 
to  all  the  displays  which  produce  such  required  information. 
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(4)  Next,  determine  if  each  piece  of  listed  information  is 
time  sensitive  and  if  the  display  which  produces  that 
information  could  be  a  significant  factor  when  the  infor¬ 
mation  was  presented.  For  example,  target  range  may  be  a 
piece  of  information  which  is  absolutely  required.  Further, 
it  is  likely  to  be  time  sensitive.  However,  if  it  is  produced 
by  a  radio,  the  radio  cannot  affect  presentation  time 
(except  by  malfunctioning).  In  this  case,  target  range 
produced  by  radio  would  not  meet  the  time  sensitivity 
criteria. 

(5)  For  each  recorded  information  requirement  that  meets  both 
of  these  criteria,  record  an  "X"  in  the  appropriate  cel  I 
of  the  X  Column. 

(6)  For  each  information  requirement  with  an  adjacent  "X" 
estimate  the  maximum  length  of  time  permissible  between 
some  fixed  point  in  time  and  the  appearance  of  that 
information.  Frequently,  the  fixed  point  in  time  will 

be  the  start  of  the  HPF.  However,  it  really  depends  upon 
the  data  ava i I ab I e. 

(7)  Record  each  permissible  time  in  the  appropriate  cell  of 
the  Time  Column.  It  is  possible  that  it  wi I  I  be  impossible 
to  make  certain  time  estimates.  If  this  cannot  be  done, 
replace  its  "X”  with  an 

(8)  Compare  the  information  requirements  listed  on  the  worksheet 
with  the  information  actually  produced  by  the  display(s) 
used  in  HPF  performance.  This  may  be  done  with  the  actual 
physical  equipment,  or  detailed  specifications  of  that 
equipment. 


SYSTEM. 

NAME- 


JEST. 


DATE. 


.PAGE 


W8-68 


-TELEPHONE. 


HRTGS 

r - 

(9)  If  a  given  piece  of  required  information  is  actually  produced, 
record  a  "1"  in  the  appropriate  cell  of  the  1/0  column.  If 
it  is  not  produced,  record  a  "0". 

(10)  For  each  piece  of  information  that  has  both  a  "1"  (from  step 
9)  and  an  "X"  (meaning  it  is  time  sensitive),  determine  the 
length  of  time  between  the  fixed  start  time  (see  step  6)  and 
the  appearance  of  that  information.  If  you  are  unable  to 
obtain  this  time  data,  record  an  asterisk  in  the  appro¬ 
priate  cell  of  the  1/0  TIME  column. 


(11)  If  a  piece  of  required  information  appears  on  or  before  the 
listed  time  limit,  record  a  "1"  in  the  appropriate  cell  of 
the  1/0  TIME  column.  If  it  does  not,  record  a  "0". 

(12)  For  each  listed  piece  of  required  information,  multiply  the 
contents  of  its  1/0  and  1/0  TIME  Cells.  An  1/0  Cell  can 
contain  a  "0",  or  a  "1".  An  1/0  TIME  Cell  can  contain  a  "0", 

a  "1",  an  asterisk  or  nothing.  Clearly,  you  only  multiply 

zeroes  and  ones.  For  each  piece  of  information,  record  the 
product  of  multiplying  the  zeroes  and  ones  in  the  appropriate 
cell  of  the  PRDCT  column.  If  an  1/0  TIME  Cell  has  an  asterisk 
or  nothing  as  its  content,  record  the  content  of  the  parallel 
1/0  Cell  in  the  PRDCT  column. 

(13)  Add  the  contents  of  the  PRDCT  column,  and  record  the  resulting 
sum  in  the  Sum  box  at  the  bottom  of  the  worksheet. 

(14)  Count  the  number  of  pieces  of  required  information  for  the 
HPF.  Divide  the  number  in  the  Sum  box  (from  step  13)  by  the 
total  number  of  pieces  of  required  information.  Record  the 
resulting  quotient  at  the  bottom  of  the  worksheet. 


(15)  Multiply  the  quotient  by  100,  and  record  the  resulting 


product  in  the  Index  box  at  the  bottom  of  the  worksheet. 
This  is  the  Index  of  Adequacy  of  this  measure.  If  it  is 
approximately  100,  all  required  information  is  present  an 
has  been  presented  soon  enough  to  be  useful.  The  further 
below  100  this  Index,  the  less  adequate  and  timely  the 
information  presented. 
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HFE  MEASURE  #4 

DISPLAY  READABILITY/HEARABILITY 
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DESCRIPTION:  HFE  Measure  #4  (Adequacy  and  Timeliness  of  Display  Infor¬ 
mation)  results  in  a  list  of  pieces  of  information  which  are  both  absolutely 
required  for  HPF  performance  and  presented  by  system  display(s)  in  time  to 
to  be  used.  Other  Information  that  is  not  absolutely  required  and  that  is 
also  presented  by  displays  may  have  some  utility  for  HPF  performance. 
However,  such  information  is,  by  definition,  not  required  for  this  perfor¬ 
mance.  Therefore,  the  only  significant  reason  for  studying  this  non- 
required  information  is  to  determine  the  "clutter"  and  overload  produced 
by  the  display(s). 

Even  if  required  information'  Is  presented  (and  presented  in  time  for  use), 
the  nature  of  its  presentation  may  vary  In  adequacy.  If  such  information 
is  presented,  but  In  an  entirely  Inadequate  manner,  it  may  be  usable.  The 
nature  of  presentation  is,  therefore,  a  possible  cause  of  inadequate  HPF 
performance. 

This  measure  Is  based  on  the  list  of  information  developed  in  HFE  Measure 
#3.  It  includes  three  worksheets.  Worksheet  #1  provides  a  format  for 
assigning  required  pieces  of  information  (from  HFE  Measure  #3)  to  their 
originating  displays.  This  Is  necessary  since  these  pieces  of  information 
are  measured  Independent  of  their  displays  In  Measure  #3.  Worksheet  #2 
provides  the  format  for  measuring  visual  displays.  Worksheet  #3  provides 
the  format  for  measuring  auditory  dipslays.  In  both  Worksheets  #2  and  #3, 
the  formats  of  required  Information  provided  by  a  single  display  are  rated, 
measured,  and  compared  to  standards. 
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PROCEDURE: 


(1)  Make  sufficient  copies  of  "Display  Readabl I ity/Hearabi I ity 
Worksheet  #1"  so  that  you  have  at  least  one  for  each  HPF 
to  be  diagnosed.  It  may  be  necessary  to  make  more  than 
one  copy  per  HPF,  depending  upon  the  amount  of  visual  and 
auditory  displays  used. 


(2)  Fill  in  the  background  data  on  each  worksheet. 


(3)  On  each  Worksheet  #1  list  all  the  visual  and  auditory 
displays  which  produce  required  information  for  the 
HPF  being  diagnosed.  Also  record  the  required  information. 
This  information  should  be  available  from  the  completed 
Measure  #3. 


(4)  Record  "X's"  in  the  appropriate  cells  of  Worksheet  il^l 
to  indicate  the  display(s)  that  produce  each  piece  of 
required  Information.  The  remainder  of  this  procedure 
applies  to  any  single  HPF  being  diagnosed. 


(5)  Examine  your  completed  Worksheet  #1,  and  determine  how 
many  visual  displays  are  listed.  Make  as  many  copies  of 
Worksheet  §2  as  you  need  for  measuring  visual  displays 
(one  worksheet  per  display).  Do  the  same  for  auditory 
displays  (copying  Worksheet  #3). 


(6)  Fill  in  the  background  information  on  each  worksheet. 


(7)  For  each  Worksheet  #2  and  #3,  apply  the  "Common  Procedures 
for  Measures  9  through  14"  found  on  page  W8-50.  Since 
you  have  already  made  copies  of  the  Measure  Worksheets, 
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SYSTEM. 


NAME- 


I  « 


it  is  not  necessary  to  respond  to  the  first  step  of 
the  Common  Procedures.  When  you  apply  the  steps  of  the 
Common  Procedures  for  a  given  display,  refer  to  your 
"Display  Readabi I Ity/Hearabi I Ity  Worksheet  #1."  In  general, 
the  characteristics  being  rated,  measures,  and  compared 
to  standards  should  be  applied  to  the  Required  Information 
which  that  display  produces.  Therefore,  keeping  Worksheet 
#1  In  front  of  you  should  prove  helpful  In  completing  the 


Common  Procedures. 


(8)  If  more  than  one  display  were  rated  in  this  Measure, 

compute  the  mean  of  the  various  Indices  of  Adequacy  which 
resulted,  and  record  this  Mean  Index  in  the  appropriate 
box  of  Worksheet  #1. 
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DISPLAY  READABILITY/HEARABILITY 
WORKSHEET  #1 


CONDITIONS  (if  applicable): 


IF  MORE  THAN  ONE  DISPLAY  IS  USED 

FOR  THIS  HPF,  RECORD  MEAN  INDEX  to 

OF  ALL  DISPLAYS  IN  BOX  WHICH  5 

a. 

FOLLOWS  (COMPUTED  FROM  WORKSHEETS  - 

Q 

#1  AND/OR  #2):  v 


MEAN  READABILITY/HEARABILITY 


INDEX  FOR  HPF 


REQUIRED  INFORMATION  FOR  HPF 
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DISPLAY  READABILITY/HEARABILITY 
WORKSHEET  #2  (VISUAL) 


SYSTEM. 

NAME— 


DISPLAY: 


CONDITIONS  (If  applicable): 


CHARACTERISTICS _ 

SIZE  OF  SYMBOL(S) 

SHAPE/STYLE  OF  SYMBOL(S) 
DEFINITION 

BRIGHTNESS _ 

FIGURE-GROUND  CONTRAST 


PLACEMENT  OF  SYMBOL(S) 

MOTION  (in  relation  to 
realworld  motion) 

RESOLUTION _ 

JITTER _ 

GREY  SCALE  GRADATION 

FLICKER  FREQUENCY 

SIGNAL  TO  NOISE  RATIO 

REFLECTIVITY _ 

SIZE  OF  DISPLAY 

VIEWING  ANGLE 

VIEWING  DISTANCE _ 

PLACEMENT _ 

FUNCTIONAL  CLUSTERING 


P  -  S 

S  o  £ 


rating  SUM: 


.TELEPHONE. 
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DISPLAY  READABILITY/HEARABILITY 
WORKSHEET  #3  (AUDITORY) 


DISPLAY: 


CONDITIONS: 


CHAflACTERISTICS 

VOLljME 

FREQUENCY  RANGE 

DYNAMIC  RANGE 

SIGNAL  TO  NOISE 
RATIO _ 

HARMONIC  DISTORTION 


u 

<-*  o 

OS 


SOURCE 


CLIPPING _ 

DISCRIMINABILITY 

ALERTING  CAPABILITY 
MASKING 

SPURIOUS  SIGNALS 
OTHER: 


RATING  SUM: 


INDEX: 


PRDCT 

SUM 
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NAME. 
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HFE  MEASURE  #5 

DISPLAY  INFORMATION  UNDERSTANDABI LITY 

DESCRIPTION:  The  purpose  of  this  measure  is  to  determine  the  adequacy 

of  that  subset  of  a  dlsplay(s)  presentation  of  required  information  which 
leads  to  the  understanding  of  that  information.  This  Is  in  some  contrast 
to  HFE  Measure  #4  which  deals  with  the  subset  of  display  presentation  which 
leads  to  perception  of  required  information.  Apart  from  this  distinction, 
this  HFE  Measure  is  basically  quite  similar  to  Measure  #4.  It  can  be  used 
without  direct  reference  to  the  specific  pieces  of  infonnation  which  are 
required  for  HPF  performance.  However  it  should  result  in  more  valid  and 
reliable  findings  if  It  is  based  on  a  completed  "Display  Visibi I ity/Hear- 
ability  Worksheet  #1"  from  HFE  Measure  #4.  In  this  measure,  you  rate 
display  understandab i I ity  on  a  multi-attribute  scale,  specific  to  each 
HPF  being  diagnosed. 

PROCEDURE: 

(1)  Make  sufficient  copies  of  "Display  Information  Understand- 
ability  Worksheet"  so  that  you  have  one  for  each  HPF  to 

be  diagnosed. 

(2)  Fill  in  the  background  on  each  worksheet.  Further  procedural 
steps  are  for  diagnosing  one  HPF. 

(3)  If  you  have  completed  HFE  Measure  #4,.  retrieve  the  filled 
in  "Display  Visibi I Ity/Hearabi I ity  Worksheet  ^1." 


(4)  Record  the  names  of  the  appropriate  displays,  used  in 
HPF  performance. 


w 
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i 


HRT€S 


(5) 


(7) 


SYSTEM. 

NAME- 


Rate  the  understandab i I i ty  of  the  presentation  of  the 
required  information  for  each  display  on  the  six  scales 
found  in  "Rating  Scales  for  Display  Information  Understand- 
ability  Worksheet,"  (page  W8-80. 


(6)  Add  all  ratings  for  each  display,  and  record  the  resulting 
sums  in  the  appropriate  cells  of  the  Sum  column. 


Divide  each  sum  (from  Step  6)  by  six"the  number  of  scales 
used.  Record  the  resulting  quotients  in  the  appropriate 
cells  of  the  Sum/6  Column.  These  are  the  Indices  of  Adequacy 
for  each  display  used  in  the  HPF.  If  a  given  display  was 
completely  adequate,  its  Index  should  be  approximately  100. 
The  less  adequate  the  display,  the  further  below  100  will 
be  the  Index. 


(8) 


If  an  HPF  used  only  one  display,  the  measure  will  now  be 
complete.  If  the  HPF  used  more  than  one  display,  compute 
the  mean  of  the  Indices  (from  Step  7).  Record  this  Mean 
Index  in  the  appropriate  box  at  the  bottom  of  ■‘‘he  worksheet, 
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I  I  RATING  SCALES  FOR  DISPLAY  INFORMATION 

I  UNDERSTANDABILITY  WORKSHEET 


1.  How  adequate  is  the  level  of  simplicity  (as  opposed  to  complexity) 
of  the  vocabulary  and/or  symbols  used  by  this  display  to  impart 
information  for  this  HPF? 


TOTALLY 

INADEQUATE 

0 


MODERATELY 

COMPLEX 

50 


COMPLETELY 

ADEQUATE 

100 


So  complex  they 
will  be  impossible 
to  understand. 


May  cause 
some  problems. 


Should  cause 
no  difficulty. 


2.  How  unfamiliar  is  the  vocabulary  and/or  symbology  used  by  this  display, 
for  this  HPF,  likely  to  be  to  the  user  population? 


TOTALLY 

UNFAMILIAR 

0 


MODERATELY 

UNFAMILIAR 

50 


ADEQUATELY 

FAMILIAR 

100 


No  transfer  of 

training 

possible. 


Some  transfer 
possible. 


Sufficient  trans¬ 
fer  of  training 
should  take  place. 


3.  To  what  extent  are  the  symbols  and/or  vocabulary  used  by  this  display, 
for  this  HPF,  similar  to  others,  known  by  the  users,  but  having  a 
different  meaning? 


TOTALLY 

CONFUSING 

0 


MODERATELY 

CONFUSING 

50 


COMPLETELY 

ADEQUATE 

100 


Identical  to  other 
symbo I s/vocabu I  ary , 
but  with  a  radical ly 
different  meaning. 


Moderate  confusion 
between  this  symbology/ 
vocabulary  and  meaning 
of  similar  one. 


Symbol  s/vocabu¬ 
lary  either 
adequately 
different  from 
other,  or  with 
adequate  I y 


similar  mean i ng . 
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HRTGS  RATING  SCALES  (CONTINUED) 


How  adequate  is  the  total  amount  of  information  presented,  at  any 
given  time  by  this  display,  for  the  understanding  of  that  information 
for  this  HPF? 


TOTALLY 

MODERATELY 

COMPLETELY 

INADEQUATE 

INADEQUATE 

ADEQUATE 

0 

25 

50 

75  100 

So  much  infor¬ 

Moderately  understanab 

e  Understandable 

mation  presented 

amount  of  information 

amount  of  infor¬ 

at  once  that  it 

presented  at  one  time. 

mation  presented 

cannot  be  understood. 

at  one  time  for 

or  so  little  that 
the  key  relationships 
are  lost. 

understand i ng . 

5.  How  adequate  is  the  amount  of  time  in  which  required  information  is  | 

presented  by  this 

disp 

ay  for  this  HPF,  for  the 

understanding  of  that 

information? 

TOTALLY 

MODERATELY 

COMPLETELY 

INADEQUATE 

INADEQUATE 

ADEQUATE 

0 

25 

50 

75  100 

Presentation  time 

Presentation  time  a 

Adequate  amount 

tot a  1 ly  much  too 

little  too  short. 

of  presentation 

short. 

time. 

6.  How  adequate  was  the  rate  of  presentation  of  information  by  this  I 

display,  for  this 

HPF, 

for  the  understanding  of 

that  information? 

TOTALLY 

MODERATELY 

COMPLETELY 

INADEQUATE 

INADEQUATE 

ADEQUATE 

0 

25 

50 

75  100 

Presentation  rate 

Moderately  inadequate 

Presentation  rate 

much  to  rapid. 

presentation  rate. 

comp  I ete 1 y 
adequate. 
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HFE  MEASURE  #6 
CONTROL  ACCESSIBILITY 


DESCRIPTION:  If  the  performance  of  an  HPF  requires  the  manipulation 

of  a  control  (or  some  other  piece  of  equipment),  the  adequacy  of  its 
accessibility  may  affect  that  performance.  The  harder  it  is  to  access  a 
piece  of  equipment  that  must  be  manipulated,  the  greater  the  likelihood 
that  the  manipulation  may  be  ineffective.  The  first  problem  in  the  measure 
is  to  identify  those  controls  and  other  pieces  of  equipment  that  must  be 
manipulated  for  the  adequate  performance  of  the  HPF  being  diagnosed.  The 
second  problem  is  to  determine  whether  each  control  or  other  piece  of 
manipulated  equipment  is  adequately  accessible  to  it  user.  Therefore,  to 
take  this  measure  you  must  have  access  to  the  actual  hardware,  detailed 
specifications  of  that  hardware,  or  similar  HFE  tests  results  from  an 
earl ier  test. 

PROCEDURE: 

(1)  Make  sufficient  copies  of  "Accessibility  Adequacy  Worksheet" 
so  that  you  have  one  copy  for  each  HPF  to  be  diagnosed. 

(2)  Fill  in  the  background  data  on  the  worksheets.  The  remaining 
procedures  will  be  directed  toward  a  single  HPF. 


(3)  On  the  worksheet,  list  all  the  controls  and  other  equipment 
that  must  be  manipulated  for  adequate  performance  of  the 
HPF  being  diagnosed.  They  should  be  listed  at  the  most 
detailed  level  possible  (for  example,  remove  screws  A  and  B, 
and  then  remove  Component  C). 


NAME 
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(4)  If  possible,  after  listing  the  control /equ i pment  list 
the  title  of  the  crew  member  who  is  supposed  to  perform 
the  manipulation  and  the  hand  or  foot  with  which  the 
manipulation  should  be  done. 


(5)  Either  take  appropriate  accessibility  measurements  for  each 
contro I /equ i pment  listed,  or  take  measurements  from  detailed 
specifications  or  previous  tests.  In  this  measure,  accessi¬ 
bility  is  determined  by: 


(a)  Reach  distance; 

(b)  Diameter/circumference  of  restricted  reach  envelope; 

(c)  Reach  angle  to  work  location  of  appropriate  individual; 

(d)  Absense  or  presence  of  potentially  obscuring  object(s) 
or  people. 


(6)  Compare  each  measure  with  its  appropraite  standard  (from 
Ml L-STD-1 472,  HEDGE,  HFTEMAN,  etc.).  In  the  absense  of 
such  objective  standards,  you  may  substitute  your  expert 
judgment,  though  this  is  substantially  less  desirable. 

(7)  If  a  given  contro I /equ i pment  meets  a  I  I  accessibility  standards 
(or  your  judgment)  record  a  "1"  in  the  appropriate  cell  of 
the  0/1  Column  or  the  worksheet.  If  it  does  not  meet  all 
such  standards,  record  a  "0". 


(8)  Record  the  source  of  your  standard  and  measurement  in  the 

appropriate  cell  of  the  Source  column.  If  there  is  insufficient 
space  in  a  cell,  record  the  source  information  on  an  appended 
sheet,  and  reference  it  in  the  cell. 
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(9)  If  a  given  control /equipment  is  given  a  "0",  it  is  suggested 

that  you  append  a  sheet,  and  describe  the  nature  of  the  accsssi- 
bility  problem  in  some  detail  on  this  sheet. 

(10)  Add  the  contents  of  the  cells  of  the  0/1  column,  and  record 
the  resulting  sum  in  the  Sum  box. 

(11)  Count  the  number  of  controls  and  pieces  of  equipment  to  be 
manipulated  for  the  HPF.  Record  this  number  in  the  #  Controls/ 
Equipment  box. 

(12)  Divide  the  sum  by  the  number  of  controls/equipment,  and 
multiply  the  resulting  quotient  by  100.  Record  this  product 
in  the  Index  box.  This  is  the  Index  of  Adequacy  of  Accessi¬ 
bility.  If  all  controls  and  other  equipment  to  be  manipulated 
are  fully  accessible,  this  index  will  be  approximately  100. 

The  less  adequate  their  accessibility,  the  further  below  100 
will  be  the  I ndex. 
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ACCESSIBILITY  ADEQUACY  WORKSHEET 


NAME 


TELEPHONE 
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HFE  MEASURE  #7 

CONTROL  STATIC  CHARACTERISTICS 


DESCRIPTION:  In  HRTES  static  characteristics,  dynamic  characteristics, 

and  accessibility  have  been  separated  into  categories  of  measures  of  control 
and  other  equipment  to  be  manipulated.  Static  characteristics  are  those 
that  affect:  location,  identification,  and  individual  activation  of  controls 
or  other  equipment  to  be  manipulated  In  the  performance  of  an  HPF  that  is 
being  diagnosed.  When  an  HPF  has  been  performed  inadequately,  one  possible 
cause  is  that  the  control (s)  or  other  equipment  which  had  to  be  manipulated 
could  not  be:  identified  in  time  by  touch  or  vision;  or  activated  indepen¬ 
dently  of  adjacent  controls.  This  measure  uses  the  "Accessibility  Adequacy 
Worksheet"  from  HFE  Measure  #6.  On  this  previous  worksheet  you  identified 
those  controls  and  other  equipment  to  be  manipulated  for  the  HPF.  These 
same  controls/equipment  will  now  have  their  static  characteristics  measured 
and  compared  to  objective  or  subjective  standards.  The  steps  of  this 
measure  are  largely  identical  to  those  described  in  Common  Procedures. 

PROCEDURE: 

(1)  Make  sufficient  copies  of  the  Measure  Worksheet  so  that  you 
have  one  for  each  HPF  to  be  diagnosed. 

(2)  Fill  in  the  background  data. 

(3)  Retrieve  your  completed  copy  of  "Accessibility  Adequacy 

Worksheet"  from  HFE  Measure  #6,  and  copy  the  controls  and 
other  equipment  to  be  manipulated.  If  Measure  #6  has  not 
been  completed,  you  will  have  to  develop  this  list  now.  It 
consists  of  those  controls  and  other  pieces  of  equipment  to 
be  manipulated  in  the  performance  of  the  HPF  that  are 
absolutely  necessary.  i 
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(4)  Study  the  characteristics  listed  on  the  worksheet.  If  you 
think  that  a  significant  characteristic  is  missing,  add  it 
in  the  "Other"  category. 

(5)  For  each  contro I /equ Ipment  listed  decide  if  each  characteristic 
on  the  worksheet  is  relevant  to  the  performance  of  the  HPF 
being  diagnosed  in  this  system.  If  it  might  have  a  significant 
effect  on  HPF  performance  in  this  system,  it  is  relevant. 

In  this  case  record  an  "X"  in  the  appropriate  cell  of  the 
Relevance  row.  If  a  characteristic  is  not  relevant,  record 
a  "0"  i n  the  cell. 

(6)  Rate  each  characteristic  that  you  have  selected  for  each 
control /equipment  on  the  criticality  scale  which  follows. 

Select  any  rating  from  1-100.  Record  the  ratings  in  the 
appropriate  cells  of  the  Rating  row. 


LOW  CRITICALITY 

J _ 

Just  important  enough 
to  be  measured.  Criti¬ 
cality  low  for  this  HPF, 


MODERATE  CRITICALITY 
_ 50 _ 

Critical ity  moderate 
for  this  HPF. 


HIGH  CRITICALITY 
_ 100 

Criticality 
Extremely  high 
for  this  HPF. 


(7)  Obtain  appropriate  measurements  of  each  characteristics  you 
have  selected.  This  may  be  done  in  the  following  ways: 

(a)  Obtaining  appropriate  measurements  from  previous  OT’s, 
DT's,  HFE  tests,  or  other  reasonably  reliable  sources; 

(b)  Physical ly  taking  the  necessary  measurements  from  the 
actual  system; 

(c)  Taking  some  version  of  the  necessary  measurements  from 
system  documentation. 


SYSTEM. 


NAME _ 


_ _ _ TELEPHON  E _ 
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r(8)  Compare  each  measurement  with  the  standard  or  specification 
which  applies  to  it.  This  may  be  done  in  the  following  ways: 


(a)  Comparison  with  reasonably  valid  specifications  such  as 
those  found  in  MIL  STD- 1472,  HEDGE,  and  HFTEMAN— this  is 
of  course,  preferable; 

(b)  Evaluation  based  on  expert  judgment — in  the  absense  of  an 
applicable  standard  your  judgment  may  be  substituted. 

(9)  If  a  given  characteristic  meets  its  standard,  record  a  "1" 
in  the  appropriate  cell  of  the  0/1  row.  If  it  does  not  meet 
its  standard  (or  your  judgment),  record  a  "0"  in  this  cell. 

(10)  Record  the  source  of  each  comparison  in  the  appropriate  cell 
of  the  Source  row.  This  should  be  information  as  to  the 
source  of  the  measurement  itself  and  the  standard.  If  there 
is  insufficient  space  to  record  all  the  required  source 
information,  append  a  page  and  use  the  space  to  refer  to  it. 

(11)  Multiply  the  0  or  1  for  each  characteristic  by  the  1-100 
rating  of  its  criticality.  Record  the  resulting  products 
in  the  appropriate  cells  of  the  Product  row. 


(12)  Add  all  the  products,  and  record  the  resulting  sum  in  the 
Product  Sum  Cells. 

(13)  Add  all  the  0  or  1  ratings  in  the  Rating  column,  and  record 
the  resulting  sum  in  the  Rating  Sum  Cells. 
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(14)  Divide  each  Product  Sum  ^  its  Rating  Sum,  and  multiply  the 
resulting  quotient  by  100.  Record  the  resulting  products  in 
the  Control  Index  Cells.  These  are  the  Indices  of  Adequacy 
for  this  measure  of  controls/equipment.  If  the  measures  of 
the  significant  characteristics  just  met  their  standards,  a 
given  Index  would  be  approximately  100.  The  less  adequate  the 
characteristics  that  are  measured,  considering  their  criticality. 


SYSTEM. 


NAME. 


the  farther  below  100  will  be  the  Index. 


(15)  Compute  the  mean  of  the  Control  Indices.  Record  it  in  the 

Mean  Index  box  of  the  worksheet.  This  is  the  Index  of  Adquacy 
static  characteristics  of  all  controls  and  equipment  to  be 
manipulated  in  the  performance  of  the  HPF  being  diagnosed. 


-TELEPHONE. 
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HFE  MEASURE  #8 

CONTROL  DYNAMIC  CHARACTERISTICS 


DESCRIPTION:  In  HRTES  static  characteristics,  dynamic  chracter i st ics, 

and  accessibility  have  been  separated  into  categories  of  measures  of  controls 
and  other  equipment  to  be  manipulated.  Dynamic  characteristics  are  those 
that  affect  control  movement  and  sensing  of  that  movement.  This  measure 
uses  either  the  "Accessibility  Adequacy  Worksheet"  from  HFE  Measure  #6,  or 
the  "Static  Characteristics  Worksheet"  from  HFE  Measure  #7.  On  these  pre¬ 
vious  Worksheets  you  identified  those  controls  and  other  equipment  to  be 
manipulated  for  the  HPF.  These  same  controls/equipment  will  now  have  their 
dynamic  characteristics  measured  and  compared  to  objective  or  subjective 
standards.  The  steps  of  this  measure  are  identical  to  those  in  HFE  Measure 
#7  and  similar  to  those  described  in  Common  Procedures. 

PROCEDURE; 

(1)  Make  sufficient  copies  of  the  Measure  Worksheet  so  that  you 
have  one  for  each  HPF  to  be  diagnosed. 

(2)  Fill  in  the  background  data. 

(3)  Retrieve  your  completed  copy  of  "Accessibility  Adequacy 
Worksheet"  from  HFE  Measure  #6,  or  "Static  Characteristics 
Worksheet"  from  HFE  Measure  #7.  Copy  the  controls  and  other 
equipment  to  be  manipulated.  If  Measures  #6  or  #7  have  not 
been  completed,  you  will  have  to  develop  this  list  now.  It 
consists  of  those  controls  and  other  pieces  of  equipment  to 
be  manipulated  in  the  performance  of  the  HPF  that  are 
absolutely  necessary. 
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(4)  Study  the  characteristics  listed  on  the  Worksheet.  If  you 
think  that  a  significant  characteristic  is  missing,  add  it 
in  the  "Other"  category. 


(5)  For  each  contro I /equipment  listed  decide  if  each  characteristic 
on  the  Worksheet  is  relevant  to  the  performance  of  the  HPF  being 
diagnosed  in  this  system.  If  it  might  have  a  significant  effect 
on  HPF  performance  in  this  system,  it  is  relevant.  In  this  case 
record  an  "X"  in  the  appropriate  cell  of  the  Relevant  Row.  If 

a  characteristic  is  not  relevant,  record  a  "0"  in  the  cell. 

(6)  Rate  each  characteristic  that  you  have  selected  for  each  control/ 
equipment  on  the  criticality  scale  which  follows.  Select  any 
rating  from  1-100.  Record  the  ratings  in  the  appropriate  cells 
of  the  Rating  Row. 

LOW  CRITICALITY  MODERATE  CRITICALITY  HIGH  CRITICALITY 

J _ 25 _ 50 _ 75 _ 100 

J ust  important  enough  Criticality  moderate  Criticality 

to  be  measured.  Criti-  for  this  HPF.  extremely  high 

cality  low  for  this  HPF.  for  this  HPF: 

(7)  Obtain  appropriate  measurements  of  each  characteristic  you 
have  selected.  This  may  be  done  in  the  following  ways: 

(a)  Obtaining  appropriate  measurements  from  previous  OT's, 

DT's,  HFE  tests,  or  other  reasonably  reliable  sources. 

(b)  Physically  taking  the  necessary  measurements  from  the 
actual  system. 

(r)  Taking  some  version  of  the  necessary  measurements  from 
system  documentation. 


(8)  Compare  each  measurement  with  the  standard  or  specification 
which  applies  to  it.  This  may  be  done  in  the  following  ways: 
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(a)  Comparison  with  reasonably  valid  specifications  such 

as  those  found  in  MIL  STD- 1472,  HEDGE,  and  HFTEMAN  —  this 
is,  of  course,  preferable. 

(b)  Evaluation  based  on  expert  judgement  —  in  the  absence  of 
an  applicable  standard  your  judgement  may  be  substituted. 


(9)  If  a  given  characteristic  meets  its  standard,  record  a  "1"  in 
the  appropriate  cell  of  the  0/1  Row.  If  it  does  not  meet  its 
standard  (or  your  judgement),  record  a  "0"  in  its  cell. 

(10)  Record  the  source  of  each  comparison  in  the  appropriate  cell 

of  the  Source  Row.  This  should  be  information  as  to  the  source 
of  the  measurement  itself  and  the  standard.  If  there  is  insuffi¬ 
cient  space  to  record  all  the  required  source  information,  append 
a  page  and  use  the  space  to  refer  to  it. 

(11)  Multiply  the  0  or  1  for  each  characteristic  by  the  1-100  rating 
of  its  criticality.  Record  the  resulting  products  in  the 
appropriate  cells  of  the  Product  Row. 

(12)  Add  all  the  products,  and  record  the  resulting  sum  in  the 
Product  Sum  Cel  Is. 

(13)  Add  all  the  0  or  1  ratings  in  the  Rating  Column,  and  record 
the  resulting  sum  in  the  Rating  Sum  Cells. 


(14)  Divide  each  Product  Sum  ^  its  Rating  Sum,  and  multiply  the 
resulting  quotient  by  100.  Record  the  resulting  products  in 
the  Control  Index  Cells.  These  are  the  Indices  of  Adequacy  for 
this  measure  of  controls/equipment.  If  the  measures  of  the 
significant  characteristics  just  met  their  standards,  a  given 
Index  would  be  approximately  100.  The  less  adequate  the 
characteristics  that  are  measured,  considering  their  criticality, 
the  farther  below  100  will  be  the  Index. 


>GI 


HRT€S 


(15)  Compute  the  mean  of  the  control  Indices.  Record  it  in  the 
Mean  Index  Box  of  the  Worksheet.  This  is  the  Index  of 
Adequacy  of  Dynamic  Characteristics  of  ai I  controls  and 
equipment  to  be  manipulated  in  the  performance  of  the  HPF 
being  discussed. 

The  procedures  for  taking  HFE  Measures  9  through  14  are  identical.  They  are 
the  "Common  Procedures  for  Measures  9  through  14."  These  common  procedures 
are  found  on  Pages  W8-50. 
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HFE  MEASURE  #9--W0RKSTATI ON  DIMENSIONAL 
CHARACTERISTICS  ADEQUACY  WORKSHEET 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


WORK  SURFACE  DEPTH 


WORK  SURFACE  HEIGHT  SITTING 


WORK  SURFACE  HEIGHT  STANDING 


WORK  SURFACE  HEIGHT  KNEELING 


WORK  SURFACE  WIDTH 


WORK  SURFACE  AREA 


WORK  SURFACE  SLOPE  (ANGLE) 


WORKSPACE  DEPTH 


WORKSPACE  HEIGHT  SITTING 


WORKSPACE  HEIGHT  STANDING 


WORKSPACE  HEIGHT  KNEELING 


WORKSPACE  UNUSUAL  POSITION  CLEARANCE 


WORKSPACE  LATERAL  AREA 
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HFE  MEASURE  #11— WORKSTATION/ENVI RON- 
MENT  VISUAL  CHARACTERISTICS  ADEQUACY 
WORKSHEET 


CONDITIONS  (If  applicable); 


VISUAL 

CHARACTERISTICS 


EXTERNAL  ILLUMINATION 


EXTERNAL  WARNING  ILLUMINATION 


WORKSTATION  AMBIENT  ILLUMINATION 


WORKSTATION  DIRECT  ILLUMINATION 


EXTERNAL  FIELD  OF  VIEW 


VIEWING  ANGLE  TO  TARGET(S) 


VIEWING  ANGLE  TO  SIGNIFICANT  PARTS 
OF  WORKSTATION  (OTHER  THAN  DISPLAYS) 

VISUAL  DISTORTION  FROM  WORKSTATION  ' 


VISUAL  OBSCURATION  FROM  WORKSTATION 


VISUAL  OBSCURATION  WITHIN  WORKSTATION 


REFLECTIVITY  WITHIN  WORKSTATION 


VISIBILITY  OF  WORKSTATION  EXTERIOR 


OTHER: 


(_> 

o 
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SOURCE 


RATING 

SUM 


SYSTEM 


PRDCT 

SUM 
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HFE  MEASURE  #12— WORKSTATION/ENVIRON¬ 
MENT  SOUND  CHARACTERISTICS  ADEQUACY 
WORKSHEET 


CONDITIONS  (If  applicable):  _ 

SOUND 

CHARACTERISTICS 


SOUND  FREQUENCY  WITHIN  WORKSTATION 


SOUND  AMPLITUDE  WITHIN  WORKSTATION 


SOUND  FREQUENCY  OUTSIDE  WORKSTATION 


SOUND  AMPLITUDE  OUTSIDE  WORKSTATION 


OTHER: 


SOURCE 


u 

u 

INDEX:  1  1 

RATING 

PRDCT 

SUM 

SUM 
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NAME _ 
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HFE  measure  j5<13--workstation  motion 

ni^  I  CHARACTERISTICS  ADEQUACY  WORKSHEET 

f - 


HPF: 


CONDITIONS  (If  applicable): 


UJ 

o 


u 


MOTION 

CHARACTERISTICS _ 

VIBRATION  AMPLITUDE  IN  WORKSTATION 


VIBRATION  FREQUENCY  IN  WORKSTATION 


AMOUNT  OF  ACCELERATION  IN  WORKSTATION 


DIRECTION  OF  ACCELERATION 

lli-MQRKSTATIQM _ 


CHARACTER  OF  MOTION  IN  WORKSTATION 


OTHER: 


1 


RATING 

SUil 


PRDCT 

SUM 


INDEX: 
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HFE  MEASURE  W--WORKSTATION/ENVIRONMENT 
VENTILATION  CHARACTERISTICS  ADEQUACY 
WORKSHEET 


CONDITIONS  (If  applicable); 


VENTILATION 


AIR  FLOW/TIME 


WORKSTATION  TEMPERATURE 


WORKSTATION  HUMIDITY 


EXTERNAL  WORKSTATION  TEMPERATURE 


PREVENTION  OF  ENTRANCE  OF 


SOURCE 


L2] 
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HFE  MEASURE  #15--W0RKSTATI0N/ENVI RONMENT 
SAFETY  CHARACTERISTICS  ADEQUACY  WORKSHEET 
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SUMMARY  WORKSHEET  FOR  HUMAN  FACTORS 
ENGINEERING  DIAGNOSIS 


HPF;  . 


CONDITIOMS  (If  «ppMc<bl|)v 


SPI; 


SrSTEK  FUNCTION:  _ 

SPECIFIC  HFE  PW»L£«  SPECIFIC  NFl  IKDCCES 

CONTRIBUTING  TO  INOECES  OF  AKQUACT 


□  UNOERSTANDUILITT 
OF  PROaOURES 


2 


OCCISION  OIFFICUETT 


□  OISPUT  INFORMATION 

aoequact  b  tiicliness 


« 


OISPIAT  READABILITY/ 
HEARABILITY 


S 


DISPLAY  INFORMATION 
UNOERSTANQABILITY 


j  jcONTROt  ACCESSIBILITY 


7 


CONTROL  STATIC 
CHARACTERISTICS 


B 


CONTROL  DYNAMIC 

characteristics 


nMDWSTATIGN  DIlCISIONAL 
CHARAaERISTICS 


10 


WORKSTATION  SEATINC 

characteristics 


n 


workstation  visual 

CHARACTERISTICS 


12 


WORKSTATION  SOUID 

characteristics 


13 


WORKSTATION  MOTION 

characteristics 


14 


WORKSTATION  VENTILATION 

characteristics 


WORKSTATION  SAFETY 
CHARACTERISTICS 


16  I  [work  load 


EXP 


or 

ajES 


COLLECTIVE 

INOECES 


HFE  INDEX  OF 
ADEQUACY 


DESIGN  FOR 
COGNITION 


[  ] 


DISPLAYS 


C  ] 


CONTROLS/OTHER 
EQUIPMENT  TO  - 
BE  WNIPULATED 


[  3 


WORKSTATION/ 

ENviRowerr 


C  3 


WORK  LOAD 


.HUNAN  FACTORS 
ENGINEERING 


C  3 


C  3 
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|tZC^  GENERAL  INSTRUCTIONS  FOR  PERSONNEL 
I  II  %  I  SELECTION  MEASURES 


DESCRIPTION:  An  operational  test  (OT)  has  been  completed  recently. 

For  the  specifics  of  this  OT,  see  "HPF  Diagnostic  Worksheet"  on  page  W8-4 
of  this  submission.  Various  operator  and  maintainer  tasks  were  measured 
during  this  OT.  One  or  more  of  these  tasks  was  evaluated  as  having  been 
performed  inadequately.  In  the  Human  Resources  Test  and  Evaluation  System 
(HRTES)  operator  and  maintainer  tasks  have  been  defined  at  a  general  level 
which  is  not  dependent  upon  the  specific  types  of  equipment  involved.  To 
avoid  confusion  with  traditional  tasks,  they  have  been  named  Human  Perfor¬ 
mance  Functions  (HPF’s).  The  '*HPF  Diagnostic  Worksheet"  on  page  W8-4 
that  lists  the  specifics  of  the  operational  test  also  lists  the  HPF's  which 
were  performed  inadequately. 


Operational  testing  and  evaluation  personnel  have  determined  that  those 
HPF's  that  are  listed  are  of  significant  importance  to  the  overall  eval¬ 
uation  of  the  system  that  was  tested.  They  need  to  know  why  these  HPF’s 
were  performed  inadequately.  One  possible  reason  is  that  the  individual 
or  individuals  who  performed  inadequately  has  significant  characteristic^ 
that  interacted  with  the  system  hardware /software  and  that  fell  outside 
the  fifth  to  ninety-fi fth  percent! I e  envelopes  for  the  appropriate  popu¬ 
lation.  In  the  case  of  measures  of  central  nervous  system  functioning, 
one  possible  reason  is  that  the  individual  or  individuals  fell  below  the 
fifth  percentile  for  the  characteristics  in  question. 


It  is  not  necessary  to  take  any  personnel  selection  measures  if  you  can 
be  sure  that  all  the  personnel  who  performed  inadequate  were  "represen¬ 
tative  soldiers"  in  all  their  significant  characteristics.  Being  a 
representative  soldier  implies  that  these  individuals  fell  within  the 
fifth  to  ninety-fifth  percentiles  for  those  significant  characteristics 
which  would  affect  HPF  performance.  Since  system  hardware  and  software 
were  supposed  to  be  designed  for  "representative  soldiers"  if  the  soldiers 
were  representative,  this  could  not  be  the  cause  of  inadequate  performance. 
However,  the  random  selection  of  military  units  to  act  as  players  in  an 
OT  does  not  guarantee  the  representativeness  of  the  soldiers  involved. 


HRTes 


Further,  you  must  deal  with  the  question  of  whether  a  "representative 
soldier"  is  supposed  to  represent  the  specific  military  population,  or 
the  appropriate  age  group  of  the  general  population. 

If  you  decide  to  take  one  of  more  Personnel  Selection  Measures,  HRTES 
contains  the  following: 


MEASURE  NAME 

MEASURE  FUNCTION 

PAGE 

W8: 

1 .  Background  that  Bears  on 

Cognitive  Functioning 

Adequacy  of  those  background 

characteristics  which  affect 

mental  work. 

117 

2.  Aptitude/Ability  that  Bears 
on  Cognitive  Functioning 

Adequacy  of  those  aptitude/ 
ability  characteristics  which 

bear  on  cognitive  functioning. 

1  18 

3.  Vision  for  Display  Use 

Adequacy  of  vision  character¬ 
istics. 

119 

4.  Anthropometry  for  Visual 

Display 

Adequacy  of  anthropometric 
characteristics  required  for 

visual  display  use. 

120 

5.  Audition  for  Auditory  Display 

Use 

Adequacy  of  audition  character¬ 
istics  required  for  auditory 

display  use. 

121 

6.  Anthropometry  for  Auditory 

Display  Use 

Adequacy  of  anthropometric 

characteristics  required  for 
auditory  display  use. 

122 

7.  L^ngth/Reach  Anthropometry 
for  Access i b i 1 ity 

1 

Adequacy  of  length-rreach 
characteristics  required  for 

control /equipment  assess i b i 1 ity 

123 

8.  Joint  Motion  for  Accessibility 

i 

Adequacy  of  joint  motion  char¬ 
acteristics  required  for  con¬ 
trol/equipment  accessibility. 

124-12: 
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MEASURE  NAME 

MEASURE  FUNCTION 

9. 

Size  Anthropometry  for 

Adequacy  of  size  characteristics 

Accessibi 1 ity 

required  for  control /equipment 
accessibility  (in  limited  space). 

10. 

Vision  for  Manipulation 

1 

Adequacy  of  vision  characteris¬ 
tics  required  for  detection  and 

use  of  controls/equipment  to  be 

man ipu 1 ated. 

1 1  . 

Anthropometry  for  Static 

Adequacy  of  anthropometric  char¬ 

Characteristics  of  Con- 

acteristics  required  to  interact 

trol s/Equipment  to  Be 

with  static  characteristics  of 

Manipulated 

controls/equipment  to  be  manip*^ 

1 ated. 

12. 

Strength  for  Manipulation 

Adequacy  of  strength  character¬ 
istics  required  for  manipulation. 

13. 

Range  of  Movement  for 

Adequacy  of  range  of  movement 

Manipulation 

characteristics  required  for 

man ipul at  ion. 

14. 

Coord  i  nation'  for 

Adequacy  of  coordination  charac¬ 

Man ipu 1  at  ion 

teristics  required  for  Manipula¬ 

tion. 

15. 

Anthropometry  for  Work¬ 

Adequacy  of  anthropometric 

station  /Env  i ronment 

characteristics  required  for 

Dimensions 

compatibility  with  workstation/ 

environment  dimensions. 

16. 

Anthropometry  for  Seats 

Adequacy  of  anthropometric  char¬ 
acteristics  required  for  compati¬ 
bility  with  seating  arrangements. 

17. 

Vision  for  Workstation/ 

Adequacy  of  vision  characteristics 

Env i ronment 

required  for  compatibility  with 

the  workstat ion /env i ronment . 

132-135 


134-135 


MEASURE  FUNCTION 
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This  section  includes  a  set  of  "Common  Procedures"  which  apply  to  a  I  I  of 
the  listed  Personnel  Selection  Measures.  If  you  have  also  received  the 
HRTES  HFE  Measures,  you  will  notice  that  the  Personnel  Selection  Measures 
"Common  Procedures"  are  largely  identical  to  the  HFE  Measures  "General 
Procedures"  plus  their  "Common  Procedures." 

Your  first  problem  will  be  to  decide  which  Personnel  Selection  Measures  to 
take  of  each  HPF  to  be  diagnosed.  During  the  OT,  players  and  observers 
filled  in  questionnaires  in  which  they  gave  their  opinions  of  the  difficulty 
of  each  HPF  and  the  reasons  for  significant  difficulty.  If  the  question¬ 
naires  indicated  significant  difficulty,  they  were  reduced  and  used  to  fill 
out  an  "Opinion  Summary  Data  Worksheet"  for  that  HPF.  Scales  1-16  and 
scale  21  of  this  Worksheet  correspond  to  the  Personnel  Selection  Measures 
listed  earlier  just  as  they  correspond  to  the  HFE  Measures.  The  reason 
for  this  parallelism  is  that  performance  difficulty  can  have  been  caused 
by  an  inadequate  interface  and/or  inadequate  user  characteristics.  For 
example,  if  an  individual  indicates  a  difficulty  in  reaching  a  control  to  a 


manipulate  it,  that  control  could  have  been  located  inappropriately  for 
the  normal  user  population,  0£  that  individual  could  have  arms  which  are 
shorter  than  the  normal  population's  fifth  percentile.  This  parallelism 
appi ies  to  all  HFE  and  Personnel  Selection  Measures. 

If  any  player  or  observer  thought  that  performing  a  given  HPF  was  difficult 
and  that  HPF  is  one  of  those  being  diagnosed  now,  you  will  have  an  "Opinion 
Summary  Data  Worksheet"  for  it  with  this  submission.  In  this  case  the 
scale  scores  listed  may  be  helpful  to  you  in  deciding  which  Personnel 
Selection  Measures  to  take.  If  a  score  indicates  significant  difficulty 
(50  or  below),  it  is  reasonable  to  take  the  corresponding  Personnel  Selection 
Measure(s)  for  that  HPF.  In  some  cases  several  Personnel  Selection  Measures, 
taken  together,  correspond  to  one  "Opinion  Summary  Data  Worksheet"  scale. 

It  is,  of  course,  possible  that  players  and  observers  were  not  able  to 
judge  whether  there  was  something  which  was  inadequate  and  produced  inade¬ 
quate  HPF  performance.  Therefore  these  scores,  if  they  are  available,  can 
only  be  a  guide  for  you  to  use  as  you  think  best.  However,  it  is  possible 
that  the  players  and  observers  did  not  believe  than  an  HPF  was  difficult. 

In  this  case  you  will  have  no  "Opinion  Summary  Data  Worksheet"  for  that  HPF, 
and  you  will  have  to  fall  back  on  your  own  resources  to  decide  which  of 
these  measures  to  take. 

Since  the  scales  of  the  "Opinion  Summary  Data  Worksheet"  and  the  Personnel 
Selection  Measures  do  not  always  equal  each  other  on  a  one  scale  to  one 
measure  relationship,  the  following  table  is  presented. 


OPINIONS  SCALES 


Understanding  Procedures 


NUMBERS  OF  PERSONNEL 
SELECTION  MEASURES 


2. 

Display  Readab i 1 i ty/Hearab i 1 ity 
Measurement 

3+4  and/or  5+6 

3. 

Display  Information  Understanding 

1+2 

4. 

Usefulness  of  Display  Information 

None 
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OPINION  SCALES 


NUMBERS  OF  PERSONNEL 
SELECTION  MEASURES 


5. 

Manipulation  Difficulty 

12+13+14 

6. 

Reach/Access i b i 1 i ty 

7+8+9 

m 

Control  Configuration 

10+1 1 

8. 

Dec i s ion  Difficulty 

1+2 

9. 

Target/Terrain  Visibility 

17 

10. 

Workstation  Design  for  Visibility 

17 

1 1  . 

Sound 

18 

12. 

Mot i on 

19 

13. 

Vent i 1  at  ion 

20 

14. 

Workstation  Dimensions 

15 

15. 

Seati ng 

16 

16. 

Safety 

None 

17. 

Training  Time 

See  Tra  in  ing 

Measures 

18. 

Pract i ce  Cond it  ion 

See  Training 

Measures 

■B 

Trainer(s) 

See  Training 

Measures 

20. 

Tra i n i ng  Method 

See  Training 

Measures 

21  . 

Workload 

21 

You  can  use  these  scale  scores  as  an  aid  in  deciding  which  Personnel 
Selection  Measures  to  take.  However,  you  cannot  use  them  in  place  of 
Personnel  Selection  Measures.  The  reason  for  this  is  as  follows: 

(1)  Scale  scores  are  parallel  to  both  Personnel  Selection  and 
HFE  Measures. 
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(2)  If  a  given  scale  score  were  used  to  replace  both  its  parallel 
Personnel  Selection  and  HFE  Measures,  one  would  not  be  able 
to  diffe  entiate  between  Personnel  Selection  and  HFE  causes 
of  inadequate  performance. 

(3)  One  could  use  a  given  scale  score  to  replace  one  of  a  paral lei 
measure  pair —  if  the  other  parallel  measure  indicated  no 
difficulty,  or  if  the  other  parallel  measure  were  considered 
fixed  and  therefore  not  taken. 

(4)  It  is  considerably  more  likely  that  Personnel  Selection  will 
be  considered  fixed  than  will  HFE.  Further,  personnel  charac¬ 
teristics  are  more  likely  to  require  specific  documentation 

as  causes  of  inadequate  performance  than  are  HFE. 

(5)  Therefore,  scale  scores  can  only  be  used  as  replacements  for 
HFE  Measures,  not  Personnel  Selection  Measures,  and  even  this 
rep  I acement  i s  d i scouraged  i n  HRTES . 

In  addition  to  the  "Opinion  Summary  Data  Worksheet,"  this  submission  should 
include  a  copy  of  the  "HPF  Diagnostic  Worksheet"  (described  earlier)  and  a 
copy  of  the  "Summary  Worksheet  for  Personnel  Selection  Diagnosis"  that  will 
be  described  in  the  following  "Common  Procedures." 

COMMON  PROCEDURES  (APPLICABLE  TO  ALL  PERSONNEL  SELECTION 

measures) : 

(1)  Read  through  these  common  procedures  and  the  Worksheets  for 
the  Personnel  Selection  Measures  to  familiarize  yourself  with 


(2)  Examine  the  "HPF  Diagnostic  Worksheet"  to  familiarize  yourself 
with  information  about  the  OT  and  the  specific  HPF's  that  are 
to  be  discussed. 


SYSTEM. 


NAME- 


■  ^  <»  W  Y>,>  J.>  w'B  V  -  M  '  U  V  ..  -1  : 


_ TELEPHONE— 

WR-1 1 1 
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(3)  Examine  the  "Opinion  Summary  Data  Worksheet"  for  each 

(if  there  is  one).  Use  their  scores  as  an  aid  to  selecting 
parallel  Personnel  Selection  Measures.  If  you  do  not  have  one 
or  more  such  Worksheets,  use  your  best  judgement  for  deciding 
which  measures  to  take  of  each  HPF. 


(4)  Make  sufficient  copies  of  the  Personnel  Selection  Measure 
Worksheets  so  that  you  have  as  many  as  you  need  for  each  HPF 
to  be  diagnosed. 

(5)  Fill  in  the  background  information  on  each  Worksheet.  Proce¬ 
dures  6-16  are  directed  toward  taking  any  single  Measure  of 
any  HPF  to  be  diagnosed. 

(6)  Study  the  characteristics  listed  on  the  worksheet.  If  you  think 
that  a  significant  characteristic  is  missing,  add  it  In  the 
"Other"  category. 


(7)  Decide  if  each  characteristic  on  the  Worksheet  is  relevant  to 
the  performance  of  the  HPF  being  diagnosed  in  this  system.  If 
it  might  have  a  significant  effect  on  HPF  performance  in  this 
system,  it  is  relevant.  In  this  case  record  an  "X"  in  the 
appropriate  cell  of  the  Relevance  Column.  If  a  characteristic 
is  not  relevant,  record  a  "0"  in  the  cell. 

(8)  If  there  is  a  column  for  designating  specific  part  of  body, 
complete  it  for  each  selected  characteristic. 

(9)  Rate  each  characteristics  that  you  have  selected  on  the 
criticality  scale  which  follows.  Select  any  rating  from  1-100. 
Record  the  ratings  in  the  appropriate  cells  of  the  Rating  Column 
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LOW  CRITICALITY 
1 


25 


MODERATE  CRITICALITY 
50  75 


HIGH  CRITICALITY 
100 


J ust  important  enough 
to  be  measured.  Criti¬ 
cality  low  for  this  HPF, 


Critical i ty  moderate 
for  this  HPF. 


Critical i ty 
extremely  high 
for  this  HPF. 


(10)  Obtain  appropriate  measurements  of  each  characteristic 

you  have  selected.  This  may  be  done  in  the  following  ways: 

(a)  Obtaining  appropriate  measurements  from  previous  OT’s, 

DT's,  HFE  tests,  or  other  reasonably  reliable  sources. 

(b)  Physically  taking  the  necessary  measurements  from  the 
actual  system. 

(c)  Taking  some  version  of  the  necessary  measurements  from 
system  documentation. 

(11)  Compare  each  measurement  with  the  standard  or  specification 
which  applies  to  it.  This  may  be  done  in  the  following  ways: 

(a)  Comparison  with  reasonably  valid  specifications  such 
as  those  found  in  MIL  STD- 1472,  HEDGE,  and  HFTEMAN  — 
this  is,  of  course,  preferable. 

(b)  Evaluation  based  on  expert  judgement  --  in  the  absence  of  an 
applicable  standard  your  judgement  may  be  substituted. 

(12)  Remember,  this  procedure  applies  only  to  those  individuals 
who  performed  the  given  HPF  below  criterion.  If  a  given  char¬ 
acteristic,  for  one  individual,  falls  inside  the  fifth  to 
ninety-fifth  percentile  envelope,  or  exceeds  the  appropriate 
standard,  or  your  judgement,  assign  (do  not  record)  a  1.  If 
it  does  not,  assign  a  0.  If  only  one  individual  performed 

this  HPF  inadeguately,  then  the  1  or  0  assigned  that  individual's 


SYSTEM. 


NAME. 


.TEST. 


DATE. 


.PAGE 


-TELEPHONE- 


we-113 
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characteristic  is  recorded  d i rect I y  in  the  appropriate 
cell  of  the  (0/1)  column.  However,  if  more  than  one  individual 
performed  this  HPF  inadequately,  then  you  will  have  to  compute 
the  mean  of  the  zeros  and  ones  for  this  characteristic.  Once 
this  has  been  computed,  record  •the  tnean  of  the  zeros  and  ones 


assigned  to  the  given  characteristic  in  the  appropriate  cell 
of  the  (0/1)  column. 

(13)  Record  the  source  of  each  comparison  in  the  appropriate  cell  of 
the  Source  Column.  This  should  be  information  as  to  the  source 
of  the  measurement  Itself  and  the  standard.  If  there  is  insuffi¬ 
cient  space  to  record  all  the  required  source  information,  append 
a  page  and  use  the  space  to  refer  to  it. 

(14)  Multiply  the  0,  1,  or  mean  for  each  characteristic  by  the  1-100 
rating  of  its  criticality.  Record  the  resulting  products  in  the 
appropriate  cells  of  the  Product  Column. 

(15)  Add  all  the  products,  and  record  the  resulting  sum  in  the  Product 
Sum  Cell. 

(16)  Add  all  the  0  or  1  ratings  in  the  Rating  Column,  and  record  the 
resulting  sum  in  the  Rating  Sum  Cell. 


(17)  Divide  the  Product  Sum  ^the  Rating  Sum,  and  multiple  the 

resulting  quotient  by  100.  Record  the  resulting  product  in  the 
Index  Cell.  This  is  the  Index  of  Adequacy  for  this  measure.  If 
the  measures  of  the  significant  characteristics  just  met  their 
standards,  the  Index  would  be  approximately  100.  The  less  adequate 
the  characteristics  that  are  measured,  considering  their 
criticality,  the  farther  below  100  will  be  the  Index. 
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(18)  When  you  have  finished  taking  the  measures  you  have  selected  for 
each  HPF,  make  as  many  copies  of  the  "Summary  Worksheet  for 
Personnel  Selection  Diagnosis"  as  you  need  for  the  HPF's  you  have 
diagnosed  (one  per  HPF). 

(19)  Fill  in  the  information  at  the  top  and  extreme  bottom  of  each 
Worksheet. 

(20)  Record  the  specific  Personnel  Selection  indices  of  adequacy  for 
the  measures  you  have  taken  for  each  HPF  being  diagnosed.  This 
is  to  be  done  in  the  appropriately  labeled  boxes  on  the  Worksheets. 

(21)  If  you  have  not  taken  a  specific  Personnel  Selection  Measure  for 
a  given  HPF,  record  an  "X"  in  the  appropriate  box  of  the  Worksheet. 


(22)  Record  the  specific  character istic(s)  which  caused  any  specific 
Index  of  Adequacy  to  be  significantly  below  100.  This  Is  to  be 
done  in  the  first  column  of  the  Worksheet.  If  necessary,  append 
an  additional  sheet  for  this  purpose,  and  reference  it  in  the 
first  column. 

(23)  Compute  the  means  of  the  specific  Indices  of  Adequacy  according 
to  the  branching  structure  on  the  Worksheet.  Means  are  to  be 
computed  of  Indices:  1+2;  3+4;  5+6;  7+8+9;  10+11;  12+13+14;  15-21. 
Record  the  resulting  seven  means  in  those  boxes  to  which  the 
branching  structure  leads.  Next,  compute  the  means  of  the  fol low¬ 
ing  means  from  the  previous  step:  (3+4)+5+6)  and  (7+8+9)+( 10+1 1 )+ 
(12+13+14).  Finally,  take  these  two  newly  computed  means,  and 
compute  the  means  of  the  following:  (1+2);  (3+4+5+6);  (7-14); 
(15-21);  and  (22).  Record  the  resulting  means  in  those  boxes  on 
the  Worksheet  appropriate  for  them. 
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(24)  If  a  1 1  the  specific  indices  are  absent,  for  a  given  collective 
index,  record  an  "X”  in  the  box  for  that  collective  Index.  If 
you  have  recorded  an  "X"  In  any  individual  box,  leave  It  out 
of  the  computation. 

(25)  When  you  have  completed  all  the  Personnel  Selection  Measures  and 
the  "Summary  Worksheet  for  Personnel  Selection  Diagnosis"  return 
all  materials  to  sender. 


SYSTEM. 


NAME. 


_ TELEPHONE _ 
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PERSONNEL  SELECTION  MEASURE  #1— 
BACKGROUND  THAT  BEARS  ON  COGNITIVE 
FUNCTIONING  ADEQUACY  WORKSHEET 


NAME. 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


^  a 

ae 

o  o. 


CIVILIAN  EDUCATION  LEVEL 


AMOUNT  OF  APPROPRIATE 


LENGTH  OF  MILITARY  SERVICE 


MILITARY  RANK 


MOS  SKILL  LEVEL 


AMOUNT  OF  APPROPRIATE 


SPECIFIC  MILITARY  TRAINING 


QUALIFICATION  LEVEL  WITH  SYSTEM 


TIME  SINCE  QUALIFICATION  WITH  SYSTEM 


OTHER: 


RATING  SUM: 


SYSTEM. 


.TELEPHONE. 
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I  PERSONNEL  SELECTION  MEASURE  #2— 

I  APTITUDE/ABILITY  THAT  BEARS  ON 

■  II  %  I  COGNITIVE  FUNCTIONING  ADEQUACY  WORKSHEET 


RATING  SUN: 


PRDCT 


INDEX: 
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PERSONNEL  SELECTION  MEASURE  #3— 
VISION  DISPLAY  USE  ADEQUACY  WORKSHEET 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


VISUAL  ACUITY-NEAR  (AT  OISPUY  DISTANCE) 


VISUAL  DISCRIMINATION  (RETINAL  PERIPHERY) 


COLOR  DISCRIMINATION 


DEPTH  DISCRIMINATION 


MOVEMENT  DISCRIMINATION 


VISUAL  SEARCH 


DARK  ADAPTATION 


SYSTEM. 

NAME- 


PAOE _ 


.TELEPHONE. 
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PERSONNEL  SELECTION  MEASURE  #4— 
ANTHROPOMETRY  FOR  VISUAL  DISPLAY  USE 
ADEQUACY  WORKSHEET 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


NECK  FLEXION-RIGHT 


NECK  FLEXION-LEFT 


NECK  FLEXION-DORSAL 


NECK  FLEXION-VENTRAL 


NCCK  ROTATION-RIGHT 


NECK  ROTATION-LEFT 


FOOT  TO  EYE  HEIGHT-STANDING 


;r  «  a 


SOURCE 
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PERSONNEL  SELECTION  MEASURE  #5- 
AUDITION  FOR  AUDITORY  DISPLAYS 
ADEQUACY  WORKSHEET 


CONDITIONS  (If  applicable): 


CHAB)>CTERIST1CS _ 

AUDITORY  ACUITY  AT  ELECTRONICALLY  1 

MODUUTED  SPEECH  FREQUENCY  RANGE 

AUDITORY  ACUITY  AT  REQUENCIES  OF  APP-  ! 
ROPRIATE  ELECTRONIC/MECHANICAL  SIGNALS 

ABILITY  TO  DISCRIMINATE  ELECTRONIC/MECH¬ 
ANICAL  SIGNALS  FROM  APPROPRIATE  MASKING 

ABILITY  TO  DETECT  FREQUENCY  CHANGE  OF 
APPROPRIATE  ELECTRONIC/MECH.  SIGNALS 

ABILITY  TO  DETECT  SOUND  PRESSURE  CHANGE 
OF  APPROPRIATE  ELECT/MECH.  SIGNALS 

HEARING  RECOVERY  FOLLOWING-ELECTRONICALLY 
MODULATED  SPEECH  FREQUENCY  RANGE 

HEARING  RECOVERY  FOLLOWING-ELECTRONIC/ 
MECHANICAL  SIGNAL(S) 

FATIGUE  TOLERANCE  FOLLOWING' LONG  TERM. 
ELECT.  MOD.  SPEECH  FREQUENCY  RANGE 

FATIGUE  TOLERANCE  FOLLOWING-LONG  TERM 
ELECTRONIC/MECHANICAL  SIGNALS 


u  S  h- 


SYSTEM. 

NAME- 


.TEST _ DATE. 
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PERSONNEL  SELECTION  MEASURE  #7— 
LENGTH/REACH  ANTHROPOMETRY 
CHARACTERISTICS  FOR  ACCESSIBILITY 
ADEQUACY  WORKSHEET 


ll?F: 


CONDITIONS  (1f  applicable): 


CKARACTERISTICS 


FORWARD  ARM  REACH-STANDING 


FORWARD  ARM  REACH-SITTING 


FORWARD  ARM  REACH-SQUATTING 


FORWARD  ARM  REACH-SUPINE 


FORWARD  ARM  REACH-PRONE 


LATERAL  ARM  REACH-STANDING 


OVERHEAD  ARM  REACH-STANDING 


OVERHEAD  ARM  REACH-SIHING 


OVERHEAD  ARM  REACH-SQUAHING 


OVERHEAD  ARM  REACH-SUPINE 


FOREARM-HAND  LENGTH 


BUTTOCK-HEEL  LENGTH 


POPLITEAL  HEIGHT 


FOOT  LENGTH 


SYSTEM. 

NAME- 


ac  o  B. 


.TELEPHONE 
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PERSONNEL  SELECTION  MEASURE  #8- 
JOINT  MOTION  FOR  ACCESSIBILITY 
ADEQUACY  WORKSHEET 


CONDITIONS  (1f  applicable): 


CHARACTERISTICS 


5  “ 


*  •  f? 


ec  — •  ->  oe  o  a. 


WRIST  FUXK-H 


WRIST  EXTENSION 


WRIST  AOOUCTION 


WRIST  ABDUCTION 


FOREARM  SUBINATION 


FOREARM  PRONATION 


ELBOW  FLEXTION 


SHOULDER  aEXION 


SHOULDER  EXTENSION 


SHOULDER  ADDUCTION 


SHOULDER  ABDUCTION 


SHOULDER  MEDIAL  ROTATIDN 


SHOULDER  LATERAL  ROTATION 

ANGULAR  LIMITS  OF  WHOLE  ARM  HORIZONTAL 
MOTION  (SPEC.  HAND  HEIGHT  ABOVE  SEAT) 

ANKLE  aEXION 


ANKLE  EXTENSION 


ANKLE  ADDUCTION 


ANKLE  ABDUaiON 


KNEE  aEXION 


KNEE  MEDIAL  ROTATION 


Continued  on  Following  Page 


SYSTEM. 

NAME- 


rating  SUM 
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PERSONNEL  SELECTION  MEASURE  #8--CONT. 


SYSTEM _ TEST _ DATE _ PAGE 

NAME _ TELEPHONE _ 


l'* 


.•V  _ 


^  WSi  ^  It  -%  . 


•'  V"  ^  ,**  v  ••• 
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PERSONNEL  SELECTION  MEASURE  #9--SIZE 
ANTHROPOMETRY  FOR  ACCESSIBILITY 
ADEQUACY  WORKSHEET 


HPF: 

.  .  > 

CONDITIONS  (if  aoDllcablel: 

UJ 

o 

ae 

> 

UJ 

CHARACTERISTICS  ^ 

LIMB:  RT, 
LT,  OR  B. 

RATING 

0/1 

PRDCT 

SOURCE 

SYSTEM. 

NAME- 


SHOULDER  (BIDELTOIO)  BREADTH 


CHEST  DEPTH 


WAIST  DEPTH 


BUTTOCK-ABDOMEN  DEPTH 


HIP  BREADTH  (STANDING) 


HIP  BREADTH  (SQUATTING) 


HAND  BREADTH 


HAND  THICKNESS 


HAND  LENGTH 


FOREARM  OIAMETER/CIRCUMFERENCE 


BICEP  OIAMETER/CIRCUMFERENCE 


THIGH  CLEARANCE 


THIGH  CIRCUMFERENCE 


OTHER: 


.TEST _ DATE 
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PERSONNEL  SELECTION  MEASURE  #10-- 
VISION  FOR  MANIPULATION  ADEQUACY 
WORKSHEET 


HRTES 


PERSONNEL  SELECTION  MEASURE  #11— 
ANTHROPOMETRY  FOR  STATIC  CHARAC¬ 
TERISTICS  OF  controls/equipment 
TO  BE  MANIPULATED  ADEQUACY  WORKSHEET 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


FOOT  TO  EYE  HEIGHT  (STANDING) 


BUnOCK  TO  EYE  HEIGHT  (SITTING) 


HANDEDNESS 


HAND  BREADTH 


INDEX  FINGER  TIP  DIAMETER/CIRCUMFERENCE 


MIDDLE  FINGER  TIP  DIAMETER/ 
CIRCUMFERENCE 


RING  FINGER  TIP  DIAMETER/CIRCUMFERENCE 


THUMB  LENGTH  TIP-FIRST  JOINT 


THUMB  DEPTH 


FOOT  BREADTH 


NECK  aEXION-LEFT 


NECK  aEXTION-RIGHT 


NECK  FLEXTION-OORSAL 


NECK  aEXION-VENTRAL 


NECK  ROTATION-RIGHT 


HECK  ROTATION-LEFT 


ANGLE  OF  SIGHT  AT  EXPECTED  HEAD 
POSITION 


i  •  t  - 


B 
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PERSONNEL  SELECTION  MEASURE  #13— 
RANGE  OF  MOVEMENT  FOR  MANIPULATION 
ADEQUACY  WORKSHEET 


CONDITIONS  (If  applicable): 

CHARACTERISTICS 


WRIST  FLEXION 


WRIST  EXTENSION 


WRIST  ADDUCTION 


WRIST  ABDUCTION 


FOREARM  SUPINATION 


FOREARM  PRONATION 


ELBOW  FLEXION 


SHOULDER  aEXION 


SHOULDER  EXTENSION 


SHOULDER  ADDUCTION 


SHOULDER  ABDUCTION 


SHOULDER  MEDIAL  ROTATION 


SHOULDER  LATERAL  ROTATION 


ANKLE  ADDUCTION 


ANKLE  ABDUCTION 


ANKU  FLEXION 


KNEE  ROTATION 


KNEE  aEXION 
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PERSONNEL  SELECTION  MEASURE  #14- 
COORDINATION  FOR  MANIPULATION 
ADEQUACY  WORKSHEET 


CONDITIONS  (IF  APPLICABLE) 


CHARACTERISTICS 


GROSS  BODY  COORDINATION 


MULTI-LIHB  COORDINATION 


HAND-EYE  COORDINATION 


MANUAL  DEXTERITY 


FINGER  DEXTERITY 


PEDAL  DEXTERITY 


CONTROL  PRECISION 


RATE  CONTROL 


FATIGUE  TOLERANCE  FOLLOWING-LONG  TERM  PErJ 
FORMANCE  OF  APPROPRIATE  MOVEMENTS 


o  fiC  ( 
?  ( 


RATING  SUmI 


SYSTEM. 

NAME- 
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PERSONNEL  SELECTION  MEASURE  #15— 

I  ANTHROPOMETRY  FOR  WORKSTATION/ENVI  RON- 

■  ■■  %  ■  MENT  DIMENSIONS  ADEQUACY  WORKSHEET 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


SHOULDER  HEIGHT  (STANDING) 


SHOULDER  BREADTH 


CHEST  DEPTH 


CHEST  BREADTH 


WAIST  DEPTH 


ELBOW  HEIGHT  (STANDING) 


HIP  BREADTH  (STANDING) 


BUTTOCK-ABDOMEN  BREADTH  (STANDING) 


SPECIFY  LEFT 

KNEE  BREADTH  RIGHT  OR  BSTR 


HEAD  CIRCUMFERENCE 


FOOT  length 


FOOT  BREADTH 


SOURCE 


PRONE  LENGTH 


HRTES 


PERSONNEL  SELECTION  MEASURE  #16- 
ANTHROPOMETRY  FOR  SEATS  ADEQUACY 
WORKSHEET 


CONDITIONS  (If  applicable): 


CHARACTERISTICS 


SITTIN6  HEIGHT  (EREa) 


SITTING  HEIGHT  (REUXED) 


SHOULDER  HEIGHT  (SIHING) 


ELBOH  REST  HEIGHT  (SITTING) 


ELBOW-FINGERTIP  LENGTH 


HEAD  LENGTH 


BUnOCK-KNEE  LENGTH 


POPLITEAL  HEIGHT 


BUTTOCK-POPLITEAL  LENGTH 


BUnOCK-HEEL  LENGTH 


FOOT  LENGTH 


BUTTOCK-HEEL  LENGTH  (DIAGONAL) 


HEAD  BREADTH 


SHOULDER  (BIDELTOID)  BREADTH 


FOREARf^  FOREARM  BREADTH 


WAIST  BREADTH  (SITTING) 


HIP-HIP  BREADTH  (SIHING) 


THIGH  CLEARANCE  HEIGHT  (SITTING) 


THIGH  BREADTH  (SITTING) 


KNEE-KNEE  BREADTH  (SITTING) 


Continued  on  Following  Page 
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M  ^  ec 

^  mj  a  e  & 


RATING  SUM 

1 

PRoa 

SUM- 

1 

INDEX 

SYSTEM. 

NAME- 


.TEST _ DATE. 

.TELEPHONE _ 


.PAGE _ 


W8-134 


PERSONNEL  SELECTION  MEASURE  #16— CONT 


HRTE5 


PERSONNEL  SELECTION  MEASURE  #17— 
VISION  FOR  workstation/environment 
ADEQUACY  WORKSHEET 


CONDITIONS  (if  applicable): 


CHARACTERISTICS 


VISUAL  ACUITY-NEAR  (AT  DISTANCE  FROM 
SIGNIFICANT  PART  OF  WORKSTATION) 


VISUAL  ACUITY-INTERMEDIATE  (AT  DISTANCE 
FROM  ENVIRONMENT  FEATURE) 


VISUAL  ACUITY-FAR  (AT  DISTANCE  FROM 
TARGET) 


VISUAL  DISCRIMINATION  (RETINAL  PERIPK) 


COLOR  DISCRIMINATION 


DARK  ADAPTATION 


LIGHT  ADAPTATION 


DEPTH  DISCRIMINATION 


MOVEMENT  DISCRIMINATION 


VISUAL  SEARCH 


EYE  DOMINANCE 


OTHER: 


•  to  u 

s 

o  » 


—  o 

at 

o  a. 


RATING  SUM 

u 

PRDCT 

SUM* 

u 

INDEX 

01 


HRTES 


PERSONNEL  SELECTION  MEASURE  #18— 
AUDITION  FOR  WORKSTATION/ENVIRONMENT 
ADEQUACY  WORKSHEET 


CONDITIONS  (if  applicable): 


CHARACTERISTICS 


AUDITORY  ACUITY  AT  NATURAL  SPEECH 
FREQUENCY  RANGE 


ABILITY  TO  DISCRIHINATE  NATURAL  SPEECH 
FREQ.  RANGE  FROM  APPROPRIATE  MASKING 


HEARING  RECOVERY  FOLLOWING- IMPULSE  NOISE 
APPROPRIATE  TO  SYSTEM  FUNCTIONS 


HEARING  RECOVERY  FOLLOWING-BLAST 
APPROPRIATE  TO  SYSTEM  FUNCTIONS 


HEARING  RECOVERY  FOLLOWING- LONG  TERM. 
HIGH  LEVEL  STEAOY-STATE  NOISE 


FATIGUE  TOLERANCE  FOLLOWING- IMPULSE 
NOISE  APPROPRIATE  TO  SYSTEM  FUNCTIONS 


FATIGUE  TOLERANCE  FOLLOWING-BLAST 
APPROPRIATE  TO  SYSTEM  FUNCTIONS 


FATIGUE  TOLERANCE  FOLLOWING- LONG  TERM. 
HIGH  LEVEL,  STEAOY-STATE  NOISE 


FATIGUE  TOLERANCE  FOLLOWING-LONG  TERN, 
LOW  LEVEL,  STEADY-STATE  NOISE 


5  g 


RATING  SUM 

1  1 

u 

INDEX  L 

SYSTEM. 

NAME- 


.TEST _ DATE 

.TELEPHONE _ 


W8-137 


HRTES 


PERSONNEL  SELECTION  MEASURE  #19-- 
CENTRAL  NERVOUS  SYSTEM  FUNCTIONING 
FOR  COMPATIBILITY  WITH  WORKSTATION 
MOTION  ADEQUACY  WORKSHEET 


IIPF: _ 


CONDITIONS  (1f  applicable): 


CHARACTERISTICS 


MOTION  SICKNESS/VERTIGO  TOLERANCE  TO 
VIBRATION  OF  APPROP.  Hz  AND  AMPLITUDE 


VOLUNTARY  MUSCULAR  CONTROL  TOLERANCE  TO 
VIBRATION  OF  APPROP.  Hz  ANO  AMPLITUDE 


REACTION  TIME  TOLERANCE  TO  VIBRATION  OF 
APPROP.  Hz  ANO  AMPLITUDE 


PERCEPTUAL  TOLERANCE  TO  VIBRATION  OF 
APPROP.  Hz  AND  AfVLITUOE 


COGNITIVE  TOLERANCE  TO  VIBRATION  OF 
APPROP.  Hz  AND  AMPLITUDE 


FATIGUE  TOLERANCE  FOLLOWING  LONG  TERM 
VIBRATION  OF  APPROP.  Hz  ANO  AMPLITUDE 


MOTION  SICKNESS/VERTIGO  TOLERANCE  TO 
ACCELERATION  OF  APPROP.  ONSH/OURATION 


VOLUNTARY  MUSCULAR  CONTROL  TOLERANCE  TO 
ACCELERATION  OF  APPROP.  ONSET/DURATION 


REACTION  TIfC  TOLERANCE  TO  ACCELERATION 
OF  APPROP.  ONSET/DURATION 


PERCEPTUAL  TOLERANCE  TO  ACCELERATION 
OF  APPROP.  ONSET/OURATION 


COGNITIVE  TOLERANCE  TO  ACCELERATION  OF 
APPROP.  ONSET/DURATION 


POSTURAL  TOLERANCE  TO  ACCELERATION  OF 
APPROP.  ONSET/OURATION 


COWIUNICATION  TOLERANCE  TO  ACCELERATION 
OF  APPROP.  ONSET/OURATION 


FATIGUE  TOLERANCE  FOLLOWING  SUSTAINED 
ACCELERATION  OF  APPROP.  ONSET 


SYSTEM. 

NAME- 


.  TELEPHONE. 


W8-138 


PERSONNEL  SELECTION  MEASURE  #20— 
CHARACTERISTICS  REQUIRED  FOR  WORKSTATION 
VENTILATION  AND  AIR  FILTRATION  ADEQUACY 
WORKSHEET 


CHARACTERISTICS 


HIGH  TENPERATURE-HHGH  HUMIDITY  TOLERANCE  IN 
APPROP.  CLOTHING/GEAR  OVER  APPROP.  TIME 


HIGH  TEMPERATURE«LOU  HUMIDITY  TOLERANCE  IN 
APPROP.  CLOTHING  GEAR  OVER  APPROP.  TIME 


LOU  TEMPERATURE  TOLERANCE  IN  APPROP. 
CLOTHING  GEAR  OVER  APPROP.  TIIC 


ENGINE  CO*euSTION  PRODUCTS  TOLERANCE 
OVER  APPROP.  TINE 


GUNFIRE  PRODUCTS  TOLERANCE  OVER 
APPROP.  TIME 


ROCPCET  FIRE  PRODUCTS  TOLERANCE  OVER 
APPROPRIATE  TINE 


TOLERANCE  TO  REDUCED  OXYGEN  SUPPLY 
OVER  APPROPRIATE  TIME 


SYSTEM 


HRT6S 

f - 


SUMMARY  WORKSHEET  FOR  PERSONNEL 
SELECTION  DIAGNOSIS 


HPF;  _ 

CONDITIONS  (if  applicable): 

SPI: _ 

SYSTEM  FUNCTION:  _ 


SPECIFIC  PERSONNEL  CHAR¬ 

SPECIFIC  PERSONNEL 

COLLECTIVE 

COLLECTIVE  | 

PERSONNEL 

ACTERISTICS  INADEQUACIES 

SELECTION  INDICES 

INDICES 

INDICES 

SELECTION 

CONTRIBUTING  TO  INDICES 

OF  ADEQUACY 

1 

2  1 

INDEX 

1 1  I  BACKGROUND 

2|  I  APHTUDE/ ABILITY 

Tn  VISION  FOR  OISPUYS 

41 - 1  ANTHROPOMETRY  FOR 

I - 1  VISUAL  DISPLAYS 

5[  I  AUDITION  FOR  DISPLAYS 

61 - 1  ANTHROPOMETRY  FOR 

I _ I  AUDITORY  DISPLAYS 


COGNITION 

□ 


OISPUY 

READABILITY 


□ 


DISPLAY 

HEARABILITY 


□ 


— DISPUYS — 

r  □ 


TT"!  LENGTH/REACH  ANTHROPOMETRY 
I _ I  FOR  ACCESSIBIUTY 

81 - 1  JOINT  NOTION  ANTHRWOMETRY 

I - 1  FOR  ACCESSIBIUTY 

91 - 1  SIZE  ANTHROPOMETRY 

1 _ 1  FOR  ACCESSIBILITY 

10|  I  VISION  FOR  MANIPULATION 

11 1 - 1  ANTHROPOMETRY  FOR  STATIC 

I _ I  CHARS.  OF  NANIPUUTION 


CONTROL 

ACCESSIBILITY 


□ 


STAHC 

CONTROL 

□ 


CONTROLS — 

□ 


12  1  I  STRENGTH  FOR  MANIPULATION 

131 - 1  RANGE  OF  MOVEMENT  FOR 

I - 1  MANIPULATION 

141 - 1  COORDINATION  FOR 

I _ I  MANIPULATION 


DYNAMIC 

CONTROL 

□ 


PERSONNEL 

SELECTION 


□ 


ANTHROPOtCTRY  FOR  HORK- 
I - 1  STATION/ENVIRONMENT 

16  I  I  ANTHROPOMETRY  FOR  SEATING 

171 - 1  VISION  FOR  NORKSTAHON/ 

I _ I  ENVIRONMENT 

18 1 - 1  AUDITION  FOR  WORKSTATION/ 

I _ 1  ENVinOMCNT 

19  r~~I  nervous  SYSTEM  CHARACTERISTICS 

I _ I  ASSOCIATED  WITH  MOTION 

20  I - 1  CHARACTERISTICS  ASSOCIATED  . 

I _ I  WITH  VENTILATION/FILTRATION 


WORK 

STATION/ 

ENVIORN- 

MENT 


□ 


WORKLOAD  TOLERANCE 
CHARAaERISTICS 


